Week(ish) note

So – High Performance Python 2nd ed finally shipped (Amazon, Goodreads) – yay! In brief we’ve added notes on how you can be a “highly performant programmer”, added some more profiling, added Pandas onto NumPy, improved the Compiling to C chapter with more Numba and a new full section on GPUs (in the first edition we said – GPUs are hard, nobody uses them, avoid them – oh, how the world moved on there!), updated async, JobLib with multiprocessing, multi-core including Dask, less RAM with Pandas and NumPy and four new “lessons from the field” from very experienced colleagues (thanks to Soledad, Linda, Vincent and Valentin). I need to write some more about this.

I posted it to Twitter and got a lot of lovely feedback.

I’ve started working on a very interesting project aimed at helping the likes of the Bank of England, the UK Government, the Civil Service and more understand the impact of the pandemic on the UK economy so fixes can be designed. My involvement is just starting, I’m hoping this will grow in interesting ways.

I put a simple solution into the Kaggle Covid 19 Week 5 competition and on the private leaderboard I’m hovering around rank 10 of 90ish. My solution takes the 5 day moving average and builds wide percentile confidence bounds – it is really dumb but it turns out to be really robust too.

For now I’ve cancelled my upcoming courses, life with the pandemic continues to be weird so I’ve decided to simplify things a bit. They’ll restart in a few months.

In other news my sourdough baking continues to improve, my radishes got pretty big, my lettuce is up, the plums and pears have started to grow and generally the garden is looking awesome. I’m also working harder at training my Spaniel, we’ve got a long way to go but having her not try to flush every cat she sees in the street is a huge step forwards.


Ian is a Chief Interim Data Scientist via his Mor Consulting. Sign-up for Data Science tutorials in London and to hear about his data science thoughts and jobs. He lives in London, is walked by his high energy Springer Spaniel and is a consumer of fine coffees.