How To Trigger A Python Script Whenever New Data Is Loaded Into A S3 Bucket?

I am trying to pull down data from an s3 bucket that gets new records by the second. Data comes in at 250+ G per hour. I am creating a Python script that will be running continuous

Solution 1:

The Amazon S3 notification feature enables you to receive notifications when certain events happen in your bucket. To enable notifications, you must first add a notification configuration that identifies the events you want Amazon S3 to publish and the destinations where you want Amazon S3 to send the notifications. You store this configuration in the notification subresource that is associated with a bucket. - Typically in Lambda...

https://docs.aws.amazon.com/AmazonS3/latest/dev/NotificationHowTo.html

Hope this helps r0ck