gcloud-monitor
gcloud-monitor is a repository of tasks that monitor and restart preemptible Google Cloud Platform Compute Engine instances to maximize availability. Continuing on the streetcred project, gcloud-monitor was spun out of …
Comparison of Pandas Compression Modes
The Problem I’ve been working on a side project to log real-time traffic statistics across Singapore and make the historic data publicly available. The real time APIs from LTA refreshes …
Deploying on Heroku vs App Engine – the basics
If you’re looking for somewhere to test deploying a small web service without much hassle and incurring costs/ much costs, Heroku and Google App Engine are 2 possible choices. This …
BigQuery + Colaboratory setup in 5 mins
For data analysis and exploration, Jupyter/IPython notebooks has often been the tool of choice for its ease in sharing work and explaining the thought process. If your data resides mainly …
argparse or argh … pass
As part of our data analytics infrastructure migration we’re using the argparse package much more heavily now to standardise how we run scripts. Along the way I ran into multiple …
To ‘b’ or not to ‘b’ – opening files in Python 3
Recently we’ve started moving our code from Python 2 to Python 3. The process has largely been smooth as most code works very similarly in both versions. However there are …
Getting destination themes from Wikivoyage text
With so much publicly available information on travel destinations these days, I was wondering if there was a simple way to extract themes for destinations around the world. This would …
Creating a destinations graph from Wikivoyage text
As someone who’s very interested in both travel and tech (check out my travel blog here), I’ve been thinking of how these 2 areas can come together to create cool …