I’ve recently built and set up a fully automated pipeline that collects real-time data from the International Space Station (ISS) .
This project showcases the power of combining lightweight, flexible tools without complicating things with heavy external databases.
How it's built:
• 𝗖𝗼𝗹𝗹𝗲𝗰𝘁𝗶𝗼𝗻: A Python script (fetchdata.py) that queries APIs to retrieve the exact position, altitude, and speed of the ISS.
• 𝗖𝗹𝗼𝘂𝗱 𝗔𝘂𝘁𝗼𝗺𝗮𝘁𝗶𝗼𝗻: Configured via GitHub Actions with scheduled runs (cron) to automatically log the position every hour, around the clock.
• 𝗦𝘁𝗼𝗿𝗮𝗴𝗲: Data is structured and saved in a local SQLite database file (data.db), which is automatically version-controlled and pushed straight back to the repository by the cloud runner.
Practical benefits:
• 𝗠𝗮𝗶𝗻𝘁𝗲𝗻𝗮𝗻𝗰𝗲-𝗳𝗿𝗲𝗲: No dedicated server needs to be kept running, and no complex database credentials or cloud servers are required.
• 𝗙𝘂𝗹𝗹 𝗰𝗼𝗻𝘁𝗿𝗼𝗹: The data is always readily available as a file for direct analysis, visualization in Jupyter Notebooks, or review via web-based tools.
• 𝗦𝗰𝗮𝗹𝗮𝗯𝗹𝗲: The exact same principle can easily be applied to any sensor or API data source.
Such a fun project showing how quickly you can go from an idea to a fully functioning cloud automation!
#Automation #Python #GitHubActions #SQLite #DataEngineering #Space #ContinuousLearning
https://github.com/digitaltboosting-ops/ISS_logger