Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tj edits on HEASoft, VOEvent, misc #35

Merged
merged 4 commits into from
Nov 6, 2024
Merged
Show file tree
Hide file tree
Changes from 3 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 16 additions & 0 deletions VOHE-Note.bib
Original file line number Diff line number Diff line change
@@ -1,3 +1,19 @@
% Origin of GCN
@ARTICLE{1995Ap&SS.231..235B,
author = {{Barthelmy}, S.~D. and {Butterworth}, P. and {Cline}, T.~L. and {Gehrels}, N. and {Fishman}, G.~J. and {Kouveliotou}, C. and {Meegan}, C.~A.},
title = "{BACODINE, the Real-Time BATSE Gamma-Ray Burst Coordinates Distribution Network}",
journal = {\apss},
keywords = {Delay Time, Scientific Community, Distribution Network, Total Delay, Distribution Method},
year = 1995,
month = sep,
volume = {231},
number = {1-2},
pages = {235-238},
doi = {10.1007/BF00658623},
adsurl = {https://ui.adsabs.harvard.edu/abs/1995Ap&SS.231..235B},
adsnote = {Provided by the SAO/NASA Astrophysics Data System}
}


%HESS paper describing data format
%related doi= {https://doi.org/10.48550/arXiv.1810.04516}
Expand Down
14 changes: 9 additions & 5 deletions VOHE-Note.tex
Original file line number Diff line number Diff line change
Expand Up @@ -593,7 +593,7 @@ \subsection{Tools for data extraction and visualisation}

\gls{HE} data are typically multi-dimensional ({\em e.g.\/}, 2 spatial dimensions, time, energy, possibly polarisation) and may be complex and diverse at lower levels. Therefore one may commonly find specific tools to process the data for a given facility, {\em e.g.\/}, CIAO for Chandra, \gls{SAS} for \gls{XMM-Newton}, or Gammapy for gamma-ray data, with a particular focus on Cherenkov data as foreseen by \gls{CTAO}.

However, many tools in a high energy astrophysics data analysis package may perform common tasks in a mission-independent way and can work well with similar data from other facilities. For example, one commonly needs to be able to filter and project the multi-dimensional data to select specific data subsets with manageable sizes and eliminate extraneous data. Some tool sets include built-in generic filtering and binning capabilities so that a general purpose region filtering and binning syntax is available to the end user.
However, many tools in a high energy astrophysics data analysis package may perform common tasks in a mission-independent way and can work well with similar data from other facilities. For example, one commonly needs to be able to filter and project the multi-dimensional data to select specific data subsets with manageable sizes and eliminate extraneous data. Some tool sets include built-in generic filtering and binning capabilities so that a general purpose region filtering and binning syntax is available to the end user. Examples include the HEASoft package\footnote{\url{https://https://heasarc.gsfc.nasa.gov/docs/software/heasoft/}} (enabled by the OGIP standards mentioned above), Gammapy\footnote{\url{https://gammapy.org/}}, Gamma-ray Data Tools (GDT)\footnote{\url{https://astro-gdt.readthedocs.io/}}, etc.

A high energy astrophysics data analysis package typically includes tools that apply or re-apply instrumental calibrations to the data, and as described above these may be observatory-specific. More general algorithms ({\em e.g.\/}, source detection) and utility tools ({\em e.g.\/}, extract an observed spectrum from a region surrounding a source) are applied to calibrated data to extract data subsets that can then be fed into modeling tools ({\em e.g.\/}, Xspec, Sherpa, or Gammapy) together with the appropriate instrumental responses (\gls{IRF}s, or \gls{RMF}s and \gls{ARF}s) to derive physical quantities. Since instrumental responses are often designed to be compliant with widely adopted standards, the tools that apply these responses in many cases will interoperate with other datasets that use the same standards.

Expand Down Expand Up @@ -660,7 +660,7 @@ \subsection{UC4: Multi-wavelength and multi-messenger science}
For both use cases, any type of data should be findable on the \gls{VO} and retrievable. And the data should have a
standardised open format (\gls{OGIP}, \gls{GADF}, \gls{VODF}).

Such use case is already in use with small data sets shared by \gls{VHE} experiments. In
Such use cases are already common with numerous examples in the x-rays in the decades that missions have been contributing to the standardized HEASoft package. Other examples include small data sets shared by \gls{VHE} experiments. In
\citep{2019A&A...625A..10N, 2022A&A...667A..36A}, groups of astronomers working on the Gammapy library had successfully
analysed DL3 data taken on the Crab nebula by different facilities (MAGIC, \gls{HESS}, FACT, VERITAS, Fermi-LAT and HAWC).
A real statistical joint analysis has been performed to derive an emitting model of the Crab pulsar wind nebula over more
Expand Down Expand Up @@ -757,7 +757,8 @@ \subsubsection{Provenance}

\subsubsection{VOEvent}

Source variability and observations of transient are common in the \gls{HE} domain, and as such, handling of alerts is generally including in the requirements of \gls{HE} observatories. Alerts are both sent and received by \gls{HE} observatories. The \gls{IVOA} recommendation VOEvent \citep{2017ivoa.spec.0320S} is thus of interest to the \gls{HE} domain.
Source variability and observations of transient are common in the \gls{HE} domain, and as such, handling of alerts is generally including in the requirements of \gls{HE} observatories. Alerts are both sent and received by \gls{HE} observatories. The \gls{IVOA} recommendation VOEvent \citep{2017ivoa.spec.0320S} is thus of interest to the \gls{HE} domain. This standard has been part of the decades-long success of of the General Coordinates Network (GCN)\footnote{\url{https://gcn.nasa.gov/}}, an alert system first created in the 1990's for BATSE \citep{1995Ap&SS.231..235B} that has been through a number of technology and standards refreshes. See also \S~\ref{sec:voevent_he}.



\subsubsection{Measurements}
Expand Down Expand Up @@ -1006,9 +1007,12 @@ \subsection{Use of Datalink for HE products}

In the first option, the "event-bundle" dataset (\ref{sec:event-bundlle-or-list}) exposed in the discovery service contains all the relevant information, e.g. several frames in the \gls{FITS} file, one corresponding to the event-list itself, and the others providing good/stable time intervals, or any \gls{IRF} file. This is what was done in the current \gls{GADF} data format (see \ref{sec:GADF}). In this option, the content of the event-list package should be properly defined in its description: what information is included and where is it in the dataset structure? The Event-list Context Data Model (see \ref{sec:EventListContext}) would be useful to provide that information.

In the second option, we would provide links to the relevant information from the base "event-list" (\ref{sec:event-bundlle-or-list}) exposed in the discovery service. This could be done using Datalink and a list of links to each contextual information such as the \gls{IRF}s. The Event-list Context Data Model (see \ref{sec:EventListContext}) would provide the concepts and vocabulary to characterise the \gls{IRF}s and other information relevant to the analysis of an event-list. These specific concepts and terms describing the various flavors of \gls{IRF}s and \gls{GTI}s will be given in the semantics and content\_qualifier FIELDS of the DataLink response to qualify the links. The different links can point to different
dereferencable URLs or alternbatively to different fragments of the same drefereencable URL as stated by the DataLink specification.
In the second option, we would provide links to the relevant information from the base "event-list" (\ref{sec:event-bundlle-or-list}) or product exposed in the discovery service. This could be done using Datalink and a list of links to each contextual information such as the \gls{IRF}s. The Event-list Context Data Model (see \ref{sec:EventListContext}) would provide the concepts and vocabulary to characterise the \gls{IRF}s and other information relevant to the analysis of an event-list. These specific concepts and terms describing the various flavors of \gls{IRF}s and \gls{GTI}s will be given in the semantics and content\_qualifier FIELDS of the DataLink response to qualify the links. The different links can point to different
dereferencable URLs or alternatively to different fragments of the same dereferencable URL as stated by the DataLink specification.

\subsection{VOEvent modernization}\lable{sec:voevent_he}
trjaffe marked this conversation as resolved.
Show resolved Hide resolved

The modern GCN is exploring new standards more compatible with modern event brokers such as Kafka. This includes defining metadata serialization in formats such as JSON and new schema\footnote{\url{https://gcn.nasa.gov/docs/notices/schema}} to describe how to use them. This interest group should actively engage the growing community of projects publishing transient alerts through systems that have outgrown the VOEvent standard.

%\todo[inline]{To be completed: show an example ?}

Expand Down
2 changes: 1 addition & 1 deletion ivoatex
trjaffe marked this conversation as resolved.
Show resolved Hide resolved
Loading