Difference between revisions of "STIX data center"

From stix
Jump to: navigation, search
 
(27 intermediate revisions by the same user not shown)
Line 1: Line 1:
This page is still under construction.
+
The STIX data center is an automated data processing, management and visualization platform developed by a team lead by [mailto:hualin.xiao@fhnw.ch Hualin Xiao], in order to process and, archive STIX telemetry data, support the operations of the instrument, and science activities with STIX data.  It receives STIX telemetry data from ESA, and then processes it into different data products automatically.  Analysis reports, instrument health status, and analysis results are displayed using responsive web GUIs.  The whole system has been deployed on a cloud server at FHNW.  
  
STIX data center is a virtual server hosted at FHNW.  
+
Thanks to its modular design and compatibility with ESA’s mission control system  SCOS2000,  the system can be easily adapted for other space missions.   After some minor modifications, it can also be applied to other use cases, such as automated data processing platforms for large scientific facilities and the Internet of Things (IoT).
== STIX Data Center tasks ==
 
Its tasks include
 
* Process STIX raw data & produce high level data products
 
* Monitor Data quality and instrument health status
 
* Provide data products and data browsing tools for  the Solar Physics Community
 
* Support STIX operations
 
* Data archiving
 
  
The data flow at STIX data center is shown in the picture below:
+
STIX data center main features:
  
 +
- Automated data processing platform for STIX
  
[[File:Stix-data-center-flow.png|500px|none|STIX data center]]
+
- Cloud-based
Data processing SW  mainly written in python.
 
NoSQL DB (MongoDB) used to stored telemetry packets, file metadata and configurations
 
  
<br>
+
- Interactive web-GUIs and Python APIs
== Algorithms ==
 
=== Offline flare location solution ===
 
  
 +
- Automated monitoring of data quality and instrument health
  
===  Flare  detection ===
+
- Support ESA's SCOS2000 standards
  
 +
- Can be adapted to other space missions and user cases easily
  
The 4-10 keV light curves are used for flare detection.
+
STIX data center contact person: [mailto:hualin.xiao@fhnw.ch Hualin Xiao] <br>
4-sec time bins are first rebinned to 1-min time bins in order to
+
[https://datacenter.stix.i4ds.net/ STIX data center Portal]
smooth light curves. Then
 
 
 
 
 
 
 
 
 
== Source code ==
 
The source code can be found at:
 
* Data processing pipeline:  https://github.com/i4Ds/STIX_python_PUB023
 
* STIX data center web applications:  https://github.com/i4Ds/STIX-data-center
 
== Developers ==
 
* Data processing software & data processing pipeline
 
** [mailto:hualin.xiao@fhnw.ch Hualin Xiao]
 
** [mailto:shane.maloney@tcd.ie Shane Maloney]
 
 
 
* Data center  
 
** [mailto:hualin.xiao@fhnw.ch Hualin Xiao]
 

Latest revision as of 14:46, 29 August 2022

The STIX data center is an automated data processing, management and visualization platform developed by a team lead by Hualin Xiao, in order to process and, archive STIX telemetry data, support the operations of the instrument, and science activities with STIX data. It receives STIX telemetry data from ESA, and then processes it into different data products automatically. Analysis reports, instrument health status, and analysis results are displayed using responsive web GUIs. The whole system has been deployed on a cloud server at FHNW.

Thanks to its modular design and compatibility with ESA’s mission control system SCOS2000, the system can be easily adapted for other space missions. After some minor modifications, it can also be applied to other use cases, such as automated data processing platforms for large scientific facilities and the Internet of Things (IoT).

STIX data center main features:

- Automated data processing platform for STIX

- Cloud-based

- Interactive web-GUIs and Python APIs

- Automated monitoring of data quality and instrument health

- Support ESA's SCOS2000 standards

- Can be adapted to other space missions and user cases easily

STIX data center contact person: Hualin Xiao
STIX data center Portal