No description
  • Python 95.2%
  • HTML 4.2%
  • CSS 0.5%
Find a file
Repository files (latest commit first)
Filename Latest commit message Latest commit date
2016-05-09 14:05:38 +10:00
data Here are *all* of the data files 2016-05-09 14:05:38 +10:00
docs A new script to produce OFAC csv files. I worked out the details in the iPython notebook first 2015-06-25 11:57:57 +10:00
mgaetl Small change to logging and additional section in cash schema file 2016-03-01 12:21:07 +11:00
schemas Small change to logging and additional section in cash schema file 2016-03-01 12:21:07 +11:00
scripts A small fix to my rollup script 2015-10-30 12:27:58 +11:00
SQL Change to order of where predicates in my debugging query 2015-08-28 08:53:47 +10:00
web Ported to Python 3 2014-01-10 14:59:30 +11:00
.hgignore Make sure I am ignoring the PyCharm project directory 2012-10-02 14:54:47 +10:00
README.txt More information in the project README 2014-05-06 12:01:33 +10:00
requirements.txt Removed most of the version numbers from requirements.txt and added a new query 2015-05-01 10:14:58 +10:00
run Ported to Python 3 2014-01-10 14:59:30 +11:00
run.fish A new run script (for fish shell) and a SQL query 2014-10-27 16:43:46 +11:00
TODO.txt First commit to this repository 2012-07-03 15:19:06 +10:00

This folder contains my UC_MGA_ETL application

It allows me to pre-process MGA data files to check for valid structure
and contents. There is a web module to display the results.

This folder should contain a file called uc_mga_etl.cfg
That file will be in windows .ini format and should contain at least the following elements;

  datadir=<path to directory containing SUA XML files>
  uri=<valid database URI>

And optionally

  logfilename=<full file name for log output>


Development
-----------

To run this application in a virtual environment you need the following packages installed;

 * psycopg2
 * lxml

and optionally

 * Flask - to run the web component
 * ipython

Full third party module requirements are in the requirements.txt file in this directory. For a simple install just do

 $ pip install -r requirements.txt