Hi there,
This sounds like a fun and demanding project - mind if I ask if you can get in touch and possibly chat a bit more about it? Are you pulling the data from web scrapes, SQL databases, rss feeds, etc, etc? How many data sources are you working with, as in how many different types and formats of data are there?
-J