Embedded Files

Cloud Automation:
𝗙𝗿𝗼𝗺 𝘁𝗵𝗲 𝘀𝗽𝗮𝗰𝗲 𝘀𝘁𝗮𝘁𝗶𝗼𝗻 𝗱𝗶𝗿𝗲𝗰𝘁𝗹𝘆 𝘁𝗼 𝘁𝗵𝗲 𝗱𝗮𝘁𝗮𝗯𝗮𝘀𝗲

I’ve recently built and set up a fully automated pipeline that collects real-time data from the International Space Station (ISS) .


This project showcases the power of combining lightweight, flexible tools without complicating things with heavy external databases.


How it's built: 

• 𝗖𝗼𝗹𝗹𝗲𝗰𝘁𝗶𝗼𝗻: A Python script (fetchdata.py) that queries APIs to retrieve the exact position, altitude, and speed of the ISS. 

• 𝗖𝗹𝗼𝘂𝗱 𝗔𝘂𝘁𝗼𝗺𝗮𝘁𝗶𝗼𝗻: Configured via GitHub  Actions with scheduled runs (cron) to automatically log the position every hour, around the clock. 

• 𝗦𝘁𝗼𝗿𝗮𝗴𝗲: Data is structured and saved in a local SQLite database file (data.db), which is automatically version-controlled and pushed straight back to the repository by the cloud runner.


Practical benefits: 

• 𝗠𝗮𝗶𝗻𝘁𝗲𝗻𝗮𝗻𝗰𝗲-𝗳𝗿𝗲𝗲: No dedicated server needs to be kept running, and no complex database credentials or cloud servers are required. 

• 𝗙𝘂𝗹𝗹 𝗰𝗼𝗻𝘁𝗿𝗼𝗹: The data is always readily available as a file for direct analysis, visualization in Jupyter Notebooks, or review via web-based tools. 

• 𝗦𝗰𝗮𝗹𝗮𝗯𝗹𝗲: The exact same principle can easily be applied to any sensor or API data source.


Such a fun project showing how quickly you can go from an idea to a fully functioning cloud automation! 


#Automation #Python #GitHubActions #SQLite #DataEngineering #Space #ContinuousLearning

https://github.com/digitaltboosting-ops/ISS_logger



Page updated
Google Sites
Report abuse