MeerKAT: a journey from commissioning to science
- Authors: Hugo, Benjamin Vorster
- Date: 2024-10-11
- Subjects: MeerKAT , Interferometry , Ionosphere , Pulsars
- Language: English
- Type: Academic theses , Doctoral theses , text
- Identifier: http://hdl.handle.net/10962/466871 , vital:76794 , DOI https://doi.org/10.21504/10962/466871
- Description: This dissertation presents a collection of work completed for the South African Radio Astronomy Observatory in characterizing calibrator fields PKS B1934-638, PKS B0407-65 and 3C286, the development of a facet-based multi-direction peeling scheme for the CUBICAL calibration framework and incorporation into an end-to-end containerized data reduction framework, a study of a transitional millisecond pulsar candidate, and characterization of baseline dependent archiving tooling for MeerKAT. Our long term studies of PKS B1934-638, PKS B0407-65 indicate that these bandpass and flux calibrators are stable over multiple years. We also find that, especially at low frequencies in the UHF band, the population of sources surrounding these stellar Gigahertz Peaked Sources (GPS) can contribute to errors two to three orders of magnitude above desired bandpass calibration solution stability, if left unmodeled. We derive new new full sky models of these fields, currently in use by the MeerKAT Science Data Processor. We characterize the MeerKAT feed alignment using the refraction-driven linearly polarized thermal light from the Moon in order to derive a new model for the linear polarization of the stable quasar 3C286 down to 544 MHz. Part of this work includes characterization of ionospheric corrections using the International Global Navigation Satelite System Service and direct measurement of total electron content above the MeerKAT site using interchange data from the South African TrigNET service. We find that current commonly-employed techniques achieve corrections to ionospheric Faraday rotation no better than 1 rad m2. This is the main limitation on the accuracy of polarimetric observation using the MeerKAT array. We find that 3C286 intrinsically depolarizes at frequencies below 1 GHz, with an associated non-linear increase in the intrinsic source rotation measure. We present an improvement to workflows using the CUBICAL calibration framework, developed at Rhodes University. Modern radio interferometers presents a significant challenge to calibrate, often necessitating memory and computeintensive direction-dependent calibration towards many directions in order to improve the fidelity of radio images in order to meet scientific goals. We developed a framework to simplify the model prediction aspect of these direction-dependent calibration workflows using targeted faceting. Using our scheme users use models derived from the DDFACET imaging package and only need to provide lattices to mark regions of sky to which direction-dependent calibration solutions need to be solved for. This simplifies a laborious multi-step process in traditional calibration packages that need to be executed per direction. The approach is compared to an image-space corrective regime and incorporated into the VERMEERKAT end-to-end calibration framework for MeerKAT data. The improved direction-dependent calibration techniques were then applied in an analysis of the transitional millisecond pulsar candidate CXOU J110926.4-650224. The link between accreting binary systems (where emission is dominated by the synchrotron emission of relativistic jets from thermo-nuclear reaction onto the Neutron Star surface by the infalling matter) and binary radio pulsars is currently elusive. This is due to the lack of a large population of such transitional systems — only three confirmed transitional systems are known at the time of writing. It is thought that infalling matter effectively quenches the radio pulsar mechanism. Our candidate was found to be variable in the optical and the X-ray, with transitions between low, high and flaring states lasting anywhere from a tens of seconds to tens of minutes, seen in archival observations spanning nearly three decades. For the first time we detect low level synchrotron emission (_ 50 mJy beam1) coincident with this system using MeerKAT, including a flare within minutes of a flare detected in X-ray using the XMM-Newton observatory. Our analysis indicate that there is no clear anti-correlated behaviour between radio and X-ray state transitions in this system, unlike other candidate systems—indicating that such transitional systems may not exhibit homogenous behaviour. This suggests that the processes driving the X-ray mode-switching in this system are not directly linked to the processes responsible for emitting radio synchrotron radiation. Finally, we consider the problem of MeerKAT data archiving. We present a qualification analysis, using MeerKAT data, of the Rhodes University baseline-dependent archiving package XOVA, which can be used to compress and archive MeerKAT data in interchange standard-compliant format. The data rates from interferometric array radio telescopes, such as MeerKAT, grow as the square of the number of antennas in such an array. For the sake of reproducibility and future reanalysis it is important to archive calibrated visibility products. The degree to which calibrated visibility products can be compressed, by averaging, depends on the amount of smearing that can be tolerated at a fixed distance from the center of the images synthesized from these visibility products. This is, traditionally, set by the longest spacing in the interferometric array, with all other spacings averaged to the same integration and channelization as the longest spacing. We find that, using baseline-dependent averaging techniques – where averaging intervals are set per interferometric spacing – we can achieve space savings an order of magnitude better than traditional averaging approaches, with no appreciable loss of image fidelity when compared to traditional averaging approaches. , Thesis (PhD) -- Faculty of Science, Faculty of Science, Physics and Electronics, 2024
- Full Text:
- Date Issued: 2024-10-11
- Authors: Hugo, Benjamin Vorster
- Date: 2024-10-11
- Subjects: MeerKAT , Interferometry , Ionosphere , Pulsars
- Language: English
- Type: Academic theses , Doctoral theses , text
- Identifier: http://hdl.handle.net/10962/466871 , vital:76794 , DOI https://doi.org/10.21504/10962/466871
- Description: This dissertation presents a collection of work completed for the South African Radio Astronomy Observatory in characterizing calibrator fields PKS B1934-638, PKS B0407-65 and 3C286, the development of a facet-based multi-direction peeling scheme for the CUBICAL calibration framework and incorporation into an end-to-end containerized data reduction framework, a study of a transitional millisecond pulsar candidate, and characterization of baseline dependent archiving tooling for MeerKAT. Our long term studies of PKS B1934-638, PKS B0407-65 indicate that these bandpass and flux calibrators are stable over multiple years. We also find that, especially at low frequencies in the UHF band, the population of sources surrounding these stellar Gigahertz Peaked Sources (GPS) can contribute to errors two to three orders of magnitude above desired bandpass calibration solution stability, if left unmodeled. We derive new new full sky models of these fields, currently in use by the MeerKAT Science Data Processor. We characterize the MeerKAT feed alignment using the refraction-driven linearly polarized thermal light from the Moon in order to derive a new model for the linear polarization of the stable quasar 3C286 down to 544 MHz. Part of this work includes characterization of ionospheric corrections using the International Global Navigation Satelite System Service and direct measurement of total electron content above the MeerKAT site using interchange data from the South African TrigNET service. We find that current commonly-employed techniques achieve corrections to ionospheric Faraday rotation no better than 1 rad m2. This is the main limitation on the accuracy of polarimetric observation using the MeerKAT array. We find that 3C286 intrinsically depolarizes at frequencies below 1 GHz, with an associated non-linear increase in the intrinsic source rotation measure. We present an improvement to workflows using the CUBICAL calibration framework, developed at Rhodes University. Modern radio interferometers presents a significant challenge to calibrate, often necessitating memory and computeintensive direction-dependent calibration towards many directions in order to improve the fidelity of radio images in order to meet scientific goals. We developed a framework to simplify the model prediction aspect of these direction-dependent calibration workflows using targeted faceting. Using our scheme users use models derived from the DDFACET imaging package and only need to provide lattices to mark regions of sky to which direction-dependent calibration solutions need to be solved for. This simplifies a laborious multi-step process in traditional calibration packages that need to be executed per direction. The approach is compared to an image-space corrective regime and incorporated into the VERMEERKAT end-to-end calibration framework for MeerKAT data. The improved direction-dependent calibration techniques were then applied in an analysis of the transitional millisecond pulsar candidate CXOU J110926.4-650224. The link between accreting binary systems (where emission is dominated by the synchrotron emission of relativistic jets from thermo-nuclear reaction onto the Neutron Star surface by the infalling matter) and binary radio pulsars is currently elusive. This is due to the lack of a large population of such transitional systems — only three confirmed transitional systems are known at the time of writing. It is thought that infalling matter effectively quenches the radio pulsar mechanism. Our candidate was found to be variable in the optical and the X-ray, with transitions between low, high and flaring states lasting anywhere from a tens of seconds to tens of minutes, seen in archival observations spanning nearly three decades. For the first time we detect low level synchrotron emission (_ 50 mJy beam1) coincident with this system using MeerKAT, including a flare within minutes of a flare detected in X-ray using the XMM-Newton observatory. Our analysis indicate that there is no clear anti-correlated behaviour between radio and X-ray state transitions in this system, unlike other candidate systems—indicating that such transitional systems may not exhibit homogenous behaviour. This suggests that the processes driving the X-ray mode-switching in this system are not directly linked to the processes responsible for emitting radio synchrotron radiation. Finally, we consider the problem of MeerKAT data archiving. We present a qualification analysis, using MeerKAT data, of the Rhodes University baseline-dependent archiving package XOVA, which can be used to compress and archive MeerKAT data in interchange standard-compliant format. The data rates from interferometric array radio telescopes, such as MeerKAT, grow as the square of the number of antennas in such an array. For the sake of reproducibility and future reanalysis it is important to archive calibrated visibility products. The degree to which calibrated visibility products can be compressed, by averaging, depends on the amount of smearing that can be tolerated at a fixed distance from the center of the images synthesized from these visibility products. This is, traditionally, set by the longest spacing in the interferometric array, with all other spacings averaged to the same integration and channelization as the longest spacing. We find that, using baseline-dependent averaging techniques – where averaging intervals are set per interferometric spacing – we can achieve space savings an order of magnitude better than traditional averaging approaches, with no appreciable loss of image fidelity when compared to traditional averaging approaches. , Thesis (PhD) -- Faculty of Science, Faculty of Science, Physics and Electronics, 2024
- Full Text:
- Date Issued: 2024-10-11
Finite precision arithmetic in Polyphase Filterbank implementations
- Authors: Myburgh, Talon
- Date: 2020
- Subjects: Radio interferometers , Interferometry , Radio telescopes , Gate array circuits , Floating-point arithmetic , Python (Computer program language) , Polyphase Filterbank , Finite precision arithmetic , MeerKAT
- Language: English
- Type: text , Thesis , Masters , MSc
- Identifier: http://hdl.handle.net/10962/146187 , vital:38503
- Description: The MeerKAT is the most sensitive radio telescope in its class, and it is important that systematic effects do not limit the dynamic range of the instrument, preventing this sensitivity from being harnessed for deep integrations. During commissioning, spurious artefacts were noted in the MeerKAT passband and the root cause was attributed to systematic errors in the digital signal path. Finite precision arithmetic used by the Polyphase Filterbank (PFB) was one of the main factors contributing to the spurious responses, together with bugs in the firmware. This thesis describes a software PFB simulator that was built to mimic the MeerKAT PFB and allow investigation into the origin and mitigation of the effects seen on the telescope. This simulator was used to investigate the effects in signal integrity of various rounding techniques, overflow strategies and dual polarisation processing in the PFB. Using the simulator to investigate a number of different signal levels, bit-width and algorithmic scenarios, it gave insight into how the periodic dips occurring in the MeerKAT passband were the result of the implementation using an inappropriate rounding strategy. It further indicated how to select the best strategy for preventing overflow while maintaining high quantization effciency in the FFT. This practice of simulating the design behaviour in the PFB independently of the tools used to design the DSP firmware, is a step towards an end-to-end simulation of the MeerKAT system (or any radio telescope using nite precision digital signal processing systems). This would be useful for design, diagnostics, signal analysis and prototyping of the overall instrument.
- Full Text:
- Date Issued: 2020
- Authors: Myburgh, Talon
- Date: 2020
- Subjects: Radio interferometers , Interferometry , Radio telescopes , Gate array circuits , Floating-point arithmetic , Python (Computer program language) , Polyphase Filterbank , Finite precision arithmetic , MeerKAT
- Language: English
- Type: text , Thesis , Masters , MSc
- Identifier: http://hdl.handle.net/10962/146187 , vital:38503
- Description: The MeerKAT is the most sensitive radio telescope in its class, and it is important that systematic effects do not limit the dynamic range of the instrument, preventing this sensitivity from being harnessed for deep integrations. During commissioning, spurious artefacts were noted in the MeerKAT passband and the root cause was attributed to systematic errors in the digital signal path. Finite precision arithmetic used by the Polyphase Filterbank (PFB) was one of the main factors contributing to the spurious responses, together with bugs in the firmware. This thesis describes a software PFB simulator that was built to mimic the MeerKAT PFB and allow investigation into the origin and mitigation of the effects seen on the telescope. This simulator was used to investigate the effects in signal integrity of various rounding techniques, overflow strategies and dual polarisation processing in the PFB. Using the simulator to investigate a number of different signal levels, bit-width and algorithmic scenarios, it gave insight into how the periodic dips occurring in the MeerKAT passband were the result of the implementation using an inappropriate rounding strategy. It further indicated how to select the best strategy for preventing overflow while maintaining high quantization effciency in the FFT. This practice of simulating the design behaviour in the PFB independently of the tools used to design the DSP firmware, is a step towards an end-to-end simulation of the MeerKAT system (or any radio telescope using nite precision digital signal processing systems). This would be useful for design, diagnostics, signal analysis and prototyping of the overall instrument.
- Full Text:
- Date Issued: 2020
CubiCal: a fast radio interferometric calibration suite exploiting complex optimisation
- Authors: Kenyon, Jonathan
- Date: 2019
- Subjects: Interferometry , Radio astronomy , Python (Computer program language) , Square Kilometre Array (Project)
- Language: English
- Type: text , Thesis , Doctoral , PhD
- Identifier: http://hdl.handle.net/10962/92341 , vital:30711
- Description: The advent of the Square Kilometre Array and its precursors marks the start of an exciting era for radio interferometry. However, with new instruments producing unprecedented quantities of data, many existing calibration algorithms and implementations will be hard-pressed to keep up. Fortunately, it has recently been shown that the radio interferometric calibration problem can be expressed concisely using the ideas of complex optimisation. The resulting framework exposes properties of the calibration problem which can be exploited to accelerate traditional non-linear least squares algorithms. We extend the existing work on the topic by considering the more general problem of calibrating a Jones chain: the product of several unknown gain terms. We also derive specialised solvers for performing phase-only, delay and pointing error calibration. In doing so, we devise a method for determining update rules for arbitrary, real-valued parametrisations of a complex gain. The solvers are implemented in an optimised Python package called CubiCal. CubiCal makes use of Cython to generate fast C and C++ routines for performing computationally demanding tasks whilst leveraging multiprocessing and shared memory to take advantage of modern, parallel hardware. The package is fully compatible with the measurement set, the most common format for interferometer data, and is well integrated with Montblanc - a third party package which implements optimised model visibility prediction. CubiCal's calibration routines are applied successfully to both simulated and real data for the field surrounding source 3C147. These tests include direction-independent and direction dependent calibration, as well as tests of the specialised solvers. Finally, we conduct extensive performance benchmarks and verify that CubiCal convincingly outperforms its most comparable competitor.
- Full Text:
- Date Issued: 2019
- Authors: Kenyon, Jonathan
- Date: 2019
- Subjects: Interferometry , Radio astronomy , Python (Computer program language) , Square Kilometre Array (Project)
- Language: English
- Type: text , Thesis , Doctoral , PhD
- Identifier: http://hdl.handle.net/10962/92341 , vital:30711
- Description: The advent of the Square Kilometre Array and its precursors marks the start of an exciting era for radio interferometry. However, with new instruments producing unprecedented quantities of data, many existing calibration algorithms and implementations will be hard-pressed to keep up. Fortunately, it has recently been shown that the radio interferometric calibration problem can be expressed concisely using the ideas of complex optimisation. The resulting framework exposes properties of the calibration problem which can be exploited to accelerate traditional non-linear least squares algorithms. We extend the existing work on the topic by considering the more general problem of calibrating a Jones chain: the product of several unknown gain terms. We also derive specialised solvers for performing phase-only, delay and pointing error calibration. In doing so, we devise a method for determining update rules for arbitrary, real-valued parametrisations of a complex gain. The solvers are implemented in an optimised Python package called CubiCal. CubiCal makes use of Cython to generate fast C and C++ routines for performing computationally demanding tasks whilst leveraging multiprocessing and shared memory to take advantage of modern, parallel hardware. The package is fully compatible with the measurement set, the most common format for interferometer data, and is well integrated with Montblanc - a third party package which implements optimised model visibility prediction. CubiCal's calibration routines are applied successfully to both simulated and real data for the field surrounding source 3C147. These tests include direction-independent and direction dependent calibration, as well as tests of the specialised solvers. Finally, we conduct extensive performance benchmarks and verify that CubiCal convincingly outperforms its most comparable competitor.
- Full Text:
- Date Issued: 2019
Advanced radio interferometric simulation and data reduction techniques
- Authors: Makhathini, Sphesihle
- Date: 2018
- Subjects: Interferometry , Radio interferometers , Algorithms , Radio telescopes , Square Kilometre Array (Project) , Very Large Array (Observatory : N.M.) , Radio astronomy
- Language: English
- Type: text , Thesis , Doctoral , PhD
- Identifier: http://hdl.handle.net/10962/57348 , vital:26875
- Description: This work shows how legacy and novel radio Interferometry software packages and algorithms can be combined to produce high-quality reductions from modern telescopes, as well as end-to-end simulations for upcoming instruments such as the Square Kilometre Array (SKA) and its pathfinders. We first use a MeqTrees based simulations framework to quantify how artefacts due to direction-dependent effects accumulate with time, and the consequences of this accumulation when observing the same field multiple times in order to reach the survey depth. Our simulations suggest that a survey like LADUMA (Looking at the Distant Universe with MeerKAT Array), which aims to achieve its survey depth of 16 µJy/beam in a 72 kHz at 1.42 GHz by observing the same field for 1000 hours, will be able to reach its target depth in the presence of these artefacts. We also present stimela, a system agnostic scripting framework for simulating, processing and imaging radio interferometric data. This framework is then used to write an end-to-end simulation pipeline in order to quantify the resolution and sensitivity of the SKA1-MID telescope (the first phase of the SKA mid-frequency telescope) as a function of frequency, as well as the scale-dependent sensitivity of the telescope. Finally, a stimela-based reduction pipeline is used to process data of the field around the source 3C147, taken by the Karl G. Jansky Very Large Array (VLA). The reconstructed image from this reduction has a typical 1a noise level of 2.87 µJy/beam, and consequently a dynamic range of 8x106:1, given the 22.58 Jy/beam flux Density of the source 3C147.
- Full Text:
- Date Issued: 2018
- Authors: Makhathini, Sphesihle
- Date: 2018
- Subjects: Interferometry , Radio interferometers , Algorithms , Radio telescopes , Square Kilometre Array (Project) , Very Large Array (Observatory : N.M.) , Radio astronomy
- Language: English
- Type: text , Thesis , Doctoral , PhD
- Identifier: http://hdl.handle.net/10962/57348 , vital:26875
- Description: This work shows how legacy and novel radio Interferometry software packages and algorithms can be combined to produce high-quality reductions from modern telescopes, as well as end-to-end simulations for upcoming instruments such as the Square Kilometre Array (SKA) and its pathfinders. We first use a MeqTrees based simulations framework to quantify how artefacts due to direction-dependent effects accumulate with time, and the consequences of this accumulation when observing the same field multiple times in order to reach the survey depth. Our simulations suggest that a survey like LADUMA (Looking at the Distant Universe with MeerKAT Array), which aims to achieve its survey depth of 16 µJy/beam in a 72 kHz at 1.42 GHz by observing the same field for 1000 hours, will be able to reach its target depth in the presence of these artefacts. We also present stimela, a system agnostic scripting framework for simulating, processing and imaging radio interferometric data. This framework is then used to write an end-to-end simulation pipeline in order to quantify the resolution and sensitivity of the SKA1-MID telescope (the first phase of the SKA mid-frequency telescope) as a function of frequency, as well as the scale-dependent sensitivity of the telescope. Finally, a stimela-based reduction pipeline is used to process data of the field around the source 3C147, taken by the Karl G. Jansky Very Large Array (VLA). The reconstructed image from this reduction has a typical 1a noise level of 2.87 µJy/beam, and consequently a dynamic range of 8x106:1, given the 22.58 Jy/beam flux Density of the source 3C147.
- Full Text:
- Date Issued: 2018
Link between ghost artefacts, source suppression and incomplete calibration sky models
- Authors: Nunhokee, Chuneeta Devi
- Date: 2015
- Subjects: Interferometry , Calibration
- Language: English
- Type: Thesis , Masters , MSc
- Identifier: vital:5556 , http://hdl.handle.net/10962/d1017900
- Description: Calibration is a fundamental step towards producing radio interferometric images. However, naive calibration produces calibration artefacts, in the guise of spurious emission, buried in the thermal noise. This work investigates these calibration artefacts, henceforth referred to as “ghosts”. A 21 cm observation with the Westerbork Synthesis Radio Telescope yielded similar ghost sources, and it was anticipated that they were due to calibrating with incomplete sky models. An analytical ghost distribution of a two-source scenario is derived to substantiate this theory and to seek answers to the related bewildering features (regular ghost pattern, points spread function-like sidelobes, independent of model flux). The theoretically predicted ghost distribution qualitatively matches with the observational ones and shows high dependence on the array geometry. The theory draws the conclusion that both the ghost phenomenon and suppression of the unmodelled flux have the same root cause. In addition, the suppression of the unmodelled flux is studied as functions of unmodelled flux, differential gain solution interval and the number of sources subjected to direction-dependent gains. These studies summarise that the suppression rate is constant irrespective of the degree of incompleteness of the calibration sky model. In the presence of a direction-dependent effect, the suppression drastically increases; however, this increase can be compensated for by using longer solution intervals.
- Full Text:
- Date Issued: 2015
- Authors: Nunhokee, Chuneeta Devi
- Date: 2015
- Subjects: Interferometry , Calibration
- Language: English
- Type: Thesis , Masters , MSc
- Identifier: vital:5556 , http://hdl.handle.net/10962/d1017900
- Description: Calibration is a fundamental step towards producing radio interferometric images. However, naive calibration produces calibration artefacts, in the guise of spurious emission, buried in the thermal noise. This work investigates these calibration artefacts, henceforth referred to as “ghosts”. A 21 cm observation with the Westerbork Synthesis Radio Telescope yielded similar ghost sources, and it was anticipated that they were due to calibrating with incomplete sky models. An analytical ghost distribution of a two-source scenario is derived to substantiate this theory and to seek answers to the related bewildering features (regular ghost pattern, points spread function-like sidelobes, independent of model flux). The theoretically predicted ghost distribution qualitatively matches with the observational ones and shows high dependence on the array geometry. The theory draws the conclusion that both the ghost phenomenon and suppression of the unmodelled flux have the same root cause. In addition, the suppression of the unmodelled flux is studied as functions of unmodelled flux, differential gain solution interval and the number of sources subjected to direction-dependent gains. These studies summarise that the suppression rate is constant irrespective of the degree of incompleteness of the calibration sky model. In the presence of a direction-dependent effect, the suppression drastically increases; however, this increase can be compensated for by using longer solution intervals.
- Full Text:
- Date Issued: 2015
- «
- ‹
- 1
- ›
- »