{"id":341,"date":"2017-03-01T11:48:14","date_gmt":"2017-03-01T10:48:14","guid":{"rendered":"https:\/\/bmk10k.aip.de\/?page_id=341"},"modified":"2021-03-11T16:37:02","modified_gmt":"2021-03-11T15:37:02","slug":"data-management","status":"publish","type":"page","link":"https:\/\/bmk10k.aip.de\/?page_id=341","title":{"rendered":"Data Management"},"content":{"rendered":"<p>The data volume is driven by the total number of fields times the number of exposures times the filters per field divided by the field size of the CCD. In a single filter, and during optimal time in the year, we can do the entire PLATO FOV within one night.<br \/>\nTherefore, our default is a single-filter operation at the time being. Then, we can afford a (field) overlapping factor of nearly 30%. With a total of 60 pointings by BMK10k, and three exposures per pointing (200s, 60s, and 10s), and additionally \u224850 calibration images per night during twilight, the nightly data rate sums up to approximately 230 CCD frames for an \u201cideal\u201d night and takes approximately 8 hours. Each frame requires a disk space of 223 MB and we thus expect \u224850 GB per night at maximum. The full visibility season of the long-pointing field is approximately 1300 hours and the expected data volume per observing season is then at most \u22489 TB without compression given the expected \u201copen roof\u201d probability.<\/p>\n<p>Two-times lossless compression makes this a data-generation rate of at most \u22481.8 MB\/s for 1300 hours. This is thus the minimum bandwidth required for continuous data transfer. The entire data-transportation chain consists of the transfer<\/p>\n<ol style=\"list-style-type: lower-alpha;\">\n<li>from the CCD controller\u2019s computer <em>azcam PC<\/em> to the main site computer <em>bmkmaster<\/em>,<\/li>\n<li>from <em>bmkmaster<\/em> to the local data archive NAS (tbd) and,<\/li>\n<li>from <em>bmkmaster<\/em> to the processing computer in Potsdam.<\/li>\n<\/ol>\n<p>Above average data rate appears no problem for a standard 1000Base TX ethernet link for local transfer.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The data volume is driven by the total number of fields times the number of exposures times the filters per field divided by the field size of the CCD. In a single filter, and during optimal time in the year, we can do the entire PLATO FOV within one night. Therefore, our default is a &hellip; <a href=\"https:\/\/bmk10k.aip.de\/?page_id=341\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Data Management<\/span> <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":5,"featured_media":552,"parent":338,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-341","page","type-page","status-publish","has-post-thumbnail","hentry"],"_links":{"self":[{"href":"https:\/\/bmk10k.aip.de\/index.php?rest_route=\/wp\/v2\/pages\/341","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bmk10k.aip.de\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/bmk10k.aip.de\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/bmk10k.aip.de\/index.php?rest_route=\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/bmk10k.aip.de\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=341"}],"version-history":[{"count":3,"href":"https:\/\/bmk10k.aip.de\/index.php?rest_route=\/wp\/v2\/pages\/341\/revisions"}],"predecessor-version":[{"id":551,"href":"https:\/\/bmk10k.aip.de\/index.php?rest_route=\/wp\/v2\/pages\/341\/revisions\/551"}],"up":[{"embeddable":true,"href":"https:\/\/bmk10k.aip.de\/index.php?rest_route=\/wp\/v2\/pages\/338"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/bmk10k.aip.de\/index.php?rest_route=\/wp\/v2\/media\/552"}],"wp:attachment":[{"href":"https:\/\/bmk10k.aip.de\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=341"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}