Skip to content

Add Data

Jon Rocha edited this page May 5, 2017 · 6 revisions

Add Data Menu

With Pisces open, you may click on the Data toolbar, mouse-over the Add option, and then select from the available data source options for the dataset that you want to add to the database. Clicking on any of the options will open a custom interface where you can populate the specifics for your desired dataset. You may also right-click on the left-hand-side menu tree to add datasets.

You would need an internet connection to import data that rely on web-based data services such as USGS and Reclamation data. You can add data from sources that use files saved on your local machine or a local network directory at any time regardless of internet connection.

Adding Web-Based Data

To add USGS data which relies on the USGS NWIS Web Services, you would need to select the USGS Series from internet option from the Add Data menu. Doing so will open the interface shown below where you may specify the site number, time period, and data type for your desired dataset. Once these required fields have been populated, clicking on OK will import data from the USGS web service into your Pisces database.

This process is typical for all of the data import functions that rely on web-based data services. The only things that will change is that you will have to specify inputs on the interface that are specific to the data service that you are importing data from.

Adding Data From Local Files

To add data using an Excel file accessible to your machine locally, you would need to select the Excel Series option from the Add Data menu option. Doing so will open the series of interfaces shown below where you may (1) select your desired Excel file, (2) specify how your data is arranged within the file, and (3) select specific datasets to add to your Pisces database.

Pisces does a few things in between each of these steps. Once you select a file and specify how your data is arranged, Pisces reads your Excel file and tries to group your data based on your data arrangement selection. Pisces will try to read your data into memory so that you may select which datasets to import into the database in the third interface. Note that there are some limitations and special conditions that Pisces would need in order for this transfer to be successful.

  • The first row is by default read in as columns headers
  • Column headers need to be unique values
  • Rows below the header row need to be a valid number; hard-coded or via an Excel equation
  • You may have multiple date columns so long as the headers are unique

This process is typical for all of the data import functions that rely on files accessible locally by your machine. The only things that will change is that you will have to specify inputs on the custom interfaces that are specific to the file type that you are importing data from. Note that there may be other limitations based on your desired data type.

Adding RBMS Data

RBMS data is imported from specifically formatted csv files.

Standard RBMS Format:

DH-005-VC,1,1/5/2016 9:59,872.88
DH-005-VC,2,1/5/2016 9:59,907.24
DH-005-VC,3,1/5/2016 9:59,939.97
DH-005-VC,4,1/5/2016 9:59,1027.41
DH-006-VC,1,1/5/2016 9:53,871.45

Column 1: location i.e. drill hole. Column 2: sub-location i.e. riser Column 3: Date/Time Column 4: data