AWS Athena allows querying files stored in S3. AWS Kinesis Firehose allows streaming data to S3. But for efficient querying you need to split your data in partitions. Here is how you can automate the process using AWS Lambda