Commit f6cbad81 authored by Steffen Hallmann's avatar Steffen Hallmann
Browse files

cleanup run selection notebook

parent ab3aed31
......@@ -6,9 +6,11 @@
"metadata": {},
"source": [
"# How to use the run table .csv to select useful runs for analysis\n",
"Currently a first overview table of the data from Greenland is available at https://www.zeuthen.desy.de/~shallman/rnog_run_summary.html. Eventually this will be replaced by a run database, but for the time being it can be used to look for useful runs for analysis.
This demo shows how to obtain a list of runs without the need to read through the entire (html) run table by eye. Instead python's pandas is used to read the table and apply a run selection."
"Currently a first overview table of the data from Greenland is available at https://www.zeuthen.desy.de/~shallman/rnog_run_summary.html.\n",
"\n",
"Eventually this will be replaced by a run database, but for the time being it can be used to look for useful runs for analysis.\n",
"\n",
"This demo shows how to obtain a list of runs without the need to read through the entire (html) run table by eye. Instead python's pandas is used to read the table and apply a run selection."
]
},
{
......@@ -474,6 +476,14 @@
"selected_runs.head()"
]
},
{
"cell_type": "markdown",
"id": "ef26b5a0-ff17-43a4-bb01-c9b293ed154b",
"metadata": {},
"source": [
"One can directly use this table of selected runs to **obtain a list of paths to the data files** (relative to the top-level directory of the data on the Zeuthen or Wisconsin clusters)"
]
},
{
"cell_type": "code",
"execution_count": 5,
......@@ -481,20 +491,17 @@
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"149"
]
},
"execution_count": 5,
"metadata": {},
"output_type": "execute_result"
"name": "stdout",
"output_type": "stream",
"text": [
"172 ['station11/run133/combined.root', 'station11/run134/combined.root', 'station11/run135/combined.root', 'station11/run136/combined.root', 'station11/run137/combined.root', 'station11/run138/combined.root', 'station11/run139/combined.root', 'station11/run140/combined.root', 'station11/run141/combined.root', 'station11/run142/combined.root']\n"
]
}
],
"source": [
"# get a list of all the files corresponding to this selection\n",
"path_list = list(selected_runs.path)\n",
"len(path_list)"
"print(len(path_list), path_list[:10])"
]
},
{
......@@ -516,38 +523,38 @@
"data": {
"text/plain": [
"[nan,\n",
" 'on site pulsing, West',\n",
" 'MISSING',\n",
" 'gps surveying, surface off',\n",
" 'Pulsing from North',\n",
" 'No Surface Trigger / Component for GPS Surveying of stations',\n",
" 'snowmobile going out to stations, deep only, surface off',\n",
" 'gps surveying, surface amps off',\n",
" 'on site pulsing, South',\n",
" 'on site pulsing, North',\n",
" 'in-situ pulsing run',\n",
" 'berm top pulser',\n",
" 'Pusling from South',\n",
" 'Pusling from East',\n",
" 'berm top pulser, channel1',\n",
" 'Going out on snowmobile, will do surface pulsing, surface channels off',\n",
" 'Pusling from south',\n",
" 'going out on snowmobile',\n",
" 'on site pulsing, East',\n",
" 'Pusling from North',\n",
" 'berm top pulsing, channel1',\n",
" 'berm top pulsing, testing avtech',\n",
" 'gps surveying at station, surface amps off',\n",
" 'berm top pulser, channel1',\n",
" 'snowmobile going out to stations',\n",
" 'berm top pulsing, nominal_triggers',\n",
" 'Pusling from south',\n",
" 'MISSING',\n",
" 'going out on snowmobile',\n",
" 'snowmobile going out to stations, deep only',\n",
" 'testing the pulser again',\n",
" 'berm-top pulser, deep trigger',\n",
" 'gps surveying, surface off',\n",
" 'berm-top pulser, first test',\n",
" 'Pusling from East',\n",
" 'on site pulsing, North',\n",
" 'berm-top pulser, chn6 trigger',\n",
" 'snowmobile going out to stations',\n",
" 'berm top pulser',\n",
" 'testing the pulser again',\n",
" 'Going out on snowmobile, will do surface pulsing, surface channels off',\n",
" 'gps surveying at station, surface amps off',\n",
" 'going out on the snowmobile',\n",
" 'berm-top pulser, deep trigger',\n",
" 'berm top pulsing',\n",
" 'on site pulsing, South',\n",
" 'gps surveying, surface amps off',\n",
" 'snowmobile going out to stations, deep only',\n",
" 'Pusling from West',\n",
" 'berm top pulsing']"
" 'snowmobile going out to stations, deep only, surface off',\n",
" 'Pusling from South',\n",
" 'Pusling from North',\n",
" 'on site pulsing, West',\n",
" 'berm top pulsing, channel1',\n",
" 'No Surface Trigger / Component for GPS Surveying of stations']"
]
},
"execution_count": 6,
......
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment