Top Banner
Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James, Thanks to CRAFT & ACES teams , ICRAR / Curtin Institute of Radio Astronomy / CAASTRO www.caastro.org
27

Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Mar 27, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Sensitivity of CRAFT Fly’s Eye searches for FRBs

Clancy W. James, Thanks to CRAFT & ACES teams

, ICRAR / Curtin Institute of Radio Astronomy / CAASTRO

www.caastro.org

Page 2: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

ASKAP

›  Closepack configuration

-  36 beams, triangular grid -  0.9 degree spacing -  Overlap at ~half power points (1132-1468 MHz)

2 C.W. James, Feb 16th 2018

›  CRAFT data

-  336 1 MHz channels / beam / antenna -  XX+YY integrated for 1500 samples -  1.265 ms resolution

Page 3: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Processing (reminder)

›  “Fredda”:

-  Fast (incoherent) dedispersion transform

-  Performs some other functions (nicens data, flags bad things)

-  May or may not work properly (Harry Qiu)

-  See K. Bannister 2017 (in preparation) for further details

-  Returns base SNR of each candidate (threshold: 7 sigma)

›  Friends of friends:

-  Groups raw Fredda candidates (in width, DM, time)

-  Selects strongest candidate (manageable rate)

›  Visual inspection (well-trained algorithm called “Ryan”):

-  Removes obvious RFI

-  Find candidates over 9.5 SNR in a single beam 3 C.W. James, Feb 16th 2018

Page 4: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Fly’s Eye strategy

›  Fly’s eye search (independent galactic plane fields, ~57 mins) ›  Pulsar check: all antennas view pulsar w. central beam (~3 minutes) ›  Pulsar cal: all antennas scan beams 1-36 through pulsar, ~2 minutes per beam

›  Early observations: used commissioned antennas (‘ak’), frequency, beam configuration varied

›  Since ~June 2017: used commissioning (‘co’) antennas, constant configuration, increasing antenna number

›  Apply processing pipeline on pulsar calibration runs to characterise sensitivity 4 C.W. James, Feb 16th 2018

Understand the system!

Page 5: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Pulsar calibration data

›  Histogram signal to noise for each antenna/beam for each scan ›  Fit B1641-45 (J1644) & B0833-45 (Vela/J0835) using lognormal fits

›  Fits calibrate data: -  Peak: ~ sensitivity -  Integral: ~ efficiency

›  Repeat for each: -  Beam -  Antenna -  Cal run

›  O~10k data points

5 C.W. James, Feb 16th 2018

sensitivity

Area: efficiency

Page 6: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Absolute sensitivity

›  Simultaneous Parkes observations -  J1644 (B1641): analyse with PSRCHIVE -  Set ASKAP SEFD, compare with Fredda σ

-  Recover nominal 2000 Jy SEFD (11 σ Fredda) -  Scatter: Fredda vs PSRCHIVE? -  Check w. analytic calc! 6 C.W. James, Feb 16th 2018

0

2

4

6

8

10

12

1500 2000 2500 3000 3500 4000 4500 5000 5500 6000 6500

σ J

1644

(ASK

AP F

redd

a)

Jy SEFD (Parkes/ASKAP: DSPSR)

Parkes SEFD (Hydra A)

15 Jy

15 Jy

ASKAP SEFD

Colours: same beam, different antennas

Thanks Ryan!

Thanks Ryan!

psrchive

Page 7: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Efficiency

›  Mean efficiency ignoring zeroes: (of Fredda / ASKAP): 0.82/0.84 -  Variation: RFI, 300Hz issue, different antennas/beams -  Different behaviour for Vela and J1644 -  Due to DM (Vela: 68, 1644: 479) and LST (Vela obs more at night in this period)

7 C.W. James, Feb 16th 2018

Page 8: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Antenna variation

›  Fit mean sensitivity: -  Pulsar ‘strengths’ (as seen by Fredda: 1.265ms x 336 x 1 MHz) -  Antenna effects -  Beam strengths -  ‘300 Hz’ noise

-  +- 5% antenna by antenna sensitivity variation (consistent with ACES measurement) 8 C.W. James, Feb 16th 2018

-0.18

-0.16

-0.14

-0.12

-0.1

-0.08

-0.06

-0.04

-0.02

0

0.02

0.04

0 5 10 15 20 25 30 35

Rela

tive s

ensi

tivity

Antenna

µσ = ppulsaraantennabbeam f n300Hz( )

Page 9: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

“300 Hz” noise

›  Power fluctuations

-  Vary with time, antenna, beam (=PAF!)

-  All due to power distribution

9 C.W. James, Feb 16th 2018

co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2

0

0.2

0.4

0.6

0.8

1

ε(α

=-2)

co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2

co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2

0

0.2

0.4

0.6

0.8

1

ε(α=-2)

co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2 co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2 co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2 co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2 co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2 co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2

P300 noise strength

Lots

None

Page 10: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Sensitivity – 300 Hz noise

10 C.W. James, Feb 16th 2018

µσ = ppulsaraantennabbeam f n300Hz( )

co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2

0

0.2

0.4

0.6

0.8

1

ε(α

=-2)

co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2co 08 co 13

co 18 co 22 co 25

co 26 co 34

α=-2

›  Base model: ›  Effects of noise vary with FDMT

parameters magic -  Normalise power to N(0,1) – but

over what timescale? ›  Effects kick in SEFD ~doubles

-  Makes sense... -  Except that getting rid of it does

not help SNR

Page 11: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Antennas x noise

›  Evolution of sensitivity

-  Lots of book-keeping!

-  Different antenna sensitivity

-  Time-varying noise

›  Effective sensitivity depends on source statistics

11 C.W. James, Feb 16th 2018

<= Add preliminary obs

Add recent obs=>

June

201

7

Dec

201

7

Plot needs updating!

R ~ S −α dRdS

~ S −α−1⎛

⎝⎜

⎠⎟

Page 12: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Sensitivity - beams

›  Base model:

›  +- 10% explicable/systematic variation ›  +- ~2% ‘inexplicable’ variation ›  Apodizing function does not provide better fit than simple radial model 12 C.W. James, Feb 16th 2018

µσ = ppulsaraantennabbeam f n300Hz( )

Apodizing function of PAF

(circles are beam centres)

Fit vs radial offset

b

r [deg]

Best fit beam values

Page 13: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Beam effects

C.W. James, Feb 16th 2018 13

›  Ekers & Macquart: MNRAS 474 (2017) 1900

-  beam shape affects FRB population statistics measurement

-  Better view: solid angle view at each sensitivity

-  What does this look like for CRAFT?

R ~ S −α dRdS

~ S −α−1⎛

⎝⎜

⎠⎟

Page 14: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Holography observations

›  Method -  Fix reference antenna to M87

-  Scan other antennas through 15x15 grid of pointings

-  Measure XX,XY,YY correlations between reference and scan antennas

-  Data processed by A Hotan to extract mean XX/XY/YX/YY products

14 C.W. James, Feb 16th 2018

Peak power when pointing here

M87 here

Beam centre must be here

RFI when pointing here

Page 15: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Beam calibration

› Method -  Create a spline interpolation in each of X and Y -  ASSUME: beam is identical at all frequencies except 1st order scaling about

beam centre

› Noise: must come from particular holography scan ›  For CRAFT: it doesn’t matter very much, because it’s there

15 C.W. James, Feb 16th 2018

Page 16: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

More beams

› Outer beams not well sampled by holography grid

16 C.W. James, Feb 16th 2018

Page 17: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

More beams

›  PAFs rotated 45 degrees on sky; holography grid is not

17 C.W. James, Feb 16th 2018

Page 18: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

More beams!

›  Variation between antennas:

-  ‘bad’ antennas/beams? Long baselines resolving M87?

-  Ambiguity: 300 Hz noise ~ power distribution network 18 C.W. James, Feb 16th 2018

Page 19: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Closepack beamshape

› CRAFT searches: -  ‘FREDDA’ scans each beam independently -  Threshold common on all beams: sensitivity is MAX() over all beams -  Ignores double chance for noise to bump beams above threshold (matters near

the beam intersection) -  Add individual beam sensitivity from pulsar fits; remove beam 35 by hand

19 C.W. James, Feb 16th 2018

Scan can not measure sidelobes at corners

Worst case: assuming all artefacts are ‘real’ (due to beams)

Page 20: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

CRAFT

› CRAFT solid angle at given sensitivity

C.W. James, Feb 2nd 2018 20

Page 21: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Beamshape

› CRAFT beamshape: weighted for α=2

21 C.W. James, Feb 16th 2018

R ~ Sthresh−α dR

dS~ S −α−1⎛

⎝⎜

⎠⎟

B

Page 22: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Beamshape

› Mean fluence correction factor: not very dependent on slope of source

›  Systematics do not matter very much – difference with Airy ideal maters at 5% level

22 C.W. James, Feb 16th 2018

Page 23: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

FDMT effects

›  ‘Fredda’ FDMT -  Incoherent dispersion search -  336 x 1 MHz channels -  1.265 ms time resolution -  Searches in DM and width space -  NO interpolation/weighting

›  Project by Mawson Sammons -  Boxcar pulse shape -  Uniform spectrum

›  Three sensitivity measures: -  “Intrinsic sensitivity” [coherent dedispersion] -  FDMT sensitivity -  Theoretical best (matched filter) sensitivity

23 C.W. James, Feb 16th 2018

Diagonal DM: ~320

NOT “Fredda” – use python mock-up of incoherent search algorithm

Page 24: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

FDMT effects

›  ‘Fredda’ FDMT -  Incoherent dispersion search -  336 x 1 MHz channels -  1.265 ms time resolution -  Searches in DM and width space -  NO interpolation/weighting

›  Project by Mawson Sammons -  Boxcar pulse shape -  Uniform spectrum

›  Three sensitivity measures: -  “Intrinsic sensitivity” [coherent dedispersion] -  FDMT sensitivity -  Theoretical best (matched filter) sensitivity given CRAFT data

24 C.W. James, Feb 16th 2018

Diagonal DM: ~320

Diagonal DM: ~320

Page 25: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Testing efficiency

›  EXAMPLE -  Pulse width 1.265 ms (one time bin) -  DM 50 (well within diagonal) -  Vary start time from 0 to 2x1.265 ms

›  FREDDA: search units 1.265 ms, DM 0.95 ›  MatchedFilter: use fractional start times ›  X-axis: signal start time in bin ›  Y-axis: recovered signal to noise

25 C.W. James, Feb 16th 2018

Page 26: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Results

›  Wider pulses: -  less “edge effects” -  More filled bins

›  High DM: -  ‘diagonal DM’ smearing

›  Low DM: -  start time matters

›  TO DO: -  Fix bugs -  Investigate t<1.265ms -  Realistic pulse shapes! -  Improve reconstruction

›  Q: can we fit FRB shape as -  Gaussian + exp tail?

26 C.W. James, Feb 16th 2018

WEIGHTED

FREDDA

PRELIMINARY! (still bugs)

Page 27: Sensitivity of CRAFT Fly’s Eye searches for FRBscaastro.org/files/0/297785289/cwjames_craft_sensitivity.pdf · Sensitivity of CRAFT Fly’s Eye searches for FRBs Clancy W. James,

Conclusion

› Calibrating sensitivity is fun!:

-  Lots of effects governing CRAFT sensitivity

-  Beamshape, RFI/other variance, antenna sensitivity,

-  FDMT search method

-  “You don’t need a complete sample, you need to understand your bias”

›  To-Do:

-  Check FDMT implemented properly (Harry)

-  Add early and recent observations

-  Investigate different pulse shapes

-  Write in terms of absolute calibration

-  Analyse frequency dependence

-  Understand FRBs... 27 C.W. James, Feb 16th 2018

Understand the system

Where is the end-to-end system simulation?