104 lines
4.6 KiB
TeX
104 lines
4.6 KiB
TeX
%
|
|
% Upload.tex
|
|
%
|
|
% SatNOGS Optical Unofficial Guide
|
|
%
|
|
% Copyright (C) 2022, Jeff Moe
|
|
%
|
|
% This document is licensed under the Creative Commons Attribution 4.0
|
|
% International Public License (CC BY-SA 4.0) by Jeff Moe.
|
|
%
|
|
|
|
\section{Push Data Upstream}
|
|
\label{sec:upload}
|
|
\index{upload}
|
|
The \gls{SatNOGS} network isn't ready for optical data yet.
|
|
So there is nothing that can be uploaded. This is under
|
|
development.
|
|
|
|
\section{File Extensions}
|
|
\label{sec:upload-extensions}
|
|
\index{formats}
|
|
The following file extensions are in use:
|
|
|
|
\begin{mdframed}[backgroundcolor=blue!10,linecolor=blue!30]
|
|
\begin{description}
|
|
\item [.cal] --- Cal % XXX
|
|
\item [.cat] --- Cat % XXX
|
|
\item [.csv] --- \gls{CSV}
|
|
\item [.dat] --- Data.
|
|
\item [.fits] --- \gls{FITS}.
|
|
\item [.png] --- \gls{PNG}.
|
|
\end{description}
|
|
\end{mdframed}
|
|
\index{FITS}\index{PNG}\index{CSV}
|
|
|
|
|
|
\section{Data Files}
|
|
\label{sec:upload-data}
|
|
\index{data}\index{stvid}\index{process}\index{acquire}
|
|
After the \texttt{stvid} acquisition and processing steps have been
|
|
run, files such as below will be generated:
|
|
|
|
\begin{minted}{sh}
|
|
2022-08-23T04:16:26.633.fits
|
|
2022-08-23T04:16:26.633.fits.cal
|
|
2022-08-23T04:16:26.633.fits.cat
|
|
2022-08-23T04:16:26.633.fits.png
|
|
2022-08-23T04:16:26.633_48473_catalog.dat
|
|
2022-08-23T04:16:26.633_48473_catalog.png
|
|
2022-08-23T04:16:26.633_52718_catalog.dat
|
|
2022-08-23T04:16:26.633_52718_catalog.png
|
|
2022-08-23T04:16:26.633_90000_unid.dat
|
|
2022-08-23T04:16:26.633_90000_unid.png
|
|
2022-08-23T04:16:26.633_hough.csv
|
|
2022-08-23T04:16:26.633_predict.csv
|
|
2022-08-23T04:16:26.633_threshold.csv
|
|
\end{minted}
|
|
|
|
|
|
\subsection{\texttt{.fits} FITS Files}
|
|
\gls{FITS} files are the main files created during acquisition and
|
|
are the main files used in processing. It has the data of
|
|
the actual image taken with the camera. FITS files will be significantly
|
|
larger than the other files, at around 35 megabytes each, depending
|
|
on sample rate and frame size.
|
|
\index{FITS}\index{acquire}\index{process}
|
|
|
|
The \texttt{stvid} program creates it's customized \gls{FITS} format
|
|
file, which is a stack up of multiple images.
|
|
I'll leave explanation of the \texttt{stvid} \gls{FITS} file structure
|
|
to the program's author, Cees Bassa:
|
|
|
|
\begin{quote}
|
|
With stvid, I typically store 10 seconds worth of video frames, 100 frames at 10 \gls{Hz} frame rate or 250 frames at 25 \gls{Hz} frame rate into a so-called ``four frame''. Here, for each pixel of the initial 100 or 250 frames, the mean, standard deviation, maximum and argmax are stored, each as its own frame. Objects that move will stand out because they will have a high (max - mean) / standard deviation, which allows me to detect trails. Once a trail is detected, the argmax frame tells me the frame number and hence the motion of the trail, and using the timestamps of the individual 100 or 250 frames, I can reconstruct the pixel position as a function of time during the 10 second exposure, using only 4 frames instead of the 100 or 250 individual video frames.
|
|
\end{quote}
|
|
\index{Bassa, Cees}
|
|
|
|
|
|
\subsection{\texttt{.cat} CAT Files}
|
|
\texttt{stvid} generates \texttt{\.cat} files, generated from \gls{FITS files}, such as:
|
|
\texttt{2022-08-23T04:16:26.633.fits.cat}.
|
|
Sample data from \texttt{.cat} file, just the top select lines of a 1033 line file:
|
|
|
|
\begin{minted}{sh}
|
|
# 1 X_IMAGE Object position along x [pixel]
|
|
# 2 Y_IMAGE Object position along y [pixel]
|
|
# 3 MAG_BEST Best of MAG_AUTO and MAG_ISOCOR [mag]
|
|
# 4 FLUX_BEST Best of FLUX_AUTO and FLUX_ISOCOR [count]
|
|
# 5 FLUX_MAX Peak flux above background [count]
|
|
# 6 BACKGROUND Background at centroid position [count]
|
|
1172.8755 11.7756 7.1775 33.80787 11.09625 16.06616
|
|
28.8250 11.4696 6.7443 50.38253 5.008112 15.81194
|
|
1347.4933 10.4887 8.3649 11.32553 2.619246 16.04644
|
|
269.9134 9.8019 8.4220 10.74506 1.56768 15.97937
|
|
468.9823 7.9780 8.8072 7.535751 5.987358 16.02673
|
|
1475.9681 6.6672 8.6115 9.024131 2.281431 16.03049
|
|
847.0105 5.9795 8.1992 13.19223 14.31796 16.08833
|
|
181.5139 5.5141 7.9473 16.63711 2.278276 15.95168
|
|
460.1482 5.1577 8.5318 9.711239 2.795708 16.02688
|
|
1559.9583 2.9245 7.5915 23.08835 6.981803 15.9909
|
|
786.5237 1.8174 6.0213 98.05751 27.88283 16.09418
|
|
...
|
|
\end{minted}
|