I'm looking at pulling some historical option data into a database. I'm looking at about 200GBs worth of data that would be dropped into 3 tables. The main index for all tables will be a symbol (string) and a date.
First question is, if I use MySQL, will the size of the data present any problems if I want to look up the latest quote on a given symbol?
Is it better to separate the historical data from the most recent data for lookup performance? I'm not too concerned if the historical data takes a little longer to fetch, but I would like the most recent data to be fairly quick.
Thanks
First question is, if I use MySQL, will the size of the data present any problems if I want to look up the latest quote on a given symbol?
Is it better to separate the historical data from the most recent data for lookup performance? I'm not too concerned if the historical data takes a little longer to fetch, but I would like the most recent data to be fairly quick.
Thanks