Nov 6, 2022SSL For RDS With Glue Python Job and AWS SDK For PandasThis blog post is the result of a recent interaction with AWS Support. As always they were very helpful in resolving the issue. AWS SDK For Pandas Recently AWS renamed the AWS data wrangler python library to AWS SDK for Pandas. This is an AWS Professional Service open source python initiative that extends the…AWS4 min readAWS4 min read
Feb 16, 2022Using Athena Views As A Source In GlueWhilst working with AWS Glue recently I noticed that I was unable to use a view created in Athena as a source for an ETL job in the same way that I could use a table that had been cataloged. The error I received was this. An error occurred while…AWS3 min readAWS3 min read
Dec 8, 2020What’s New in ML? re:Invent ML KeynoteIt’s week two of re:Invent and that includes the first ever dedicated keynote for Machine Learning. Here are the features that I found interesting.AWS3 min readAWS3 min read
Dec 6, 2020Unify data silos with AWS AppSyncSilos Most organisations that process data will have experienced the concept of data in silos. This is where an application is built for a particular purpose and tied to a data store. While this may solve a particular business problem, as time passes developers and engineers may start to spend time…AWS6 min readAWS6 min read
Dec 1, 2020Whats New In Data: re:invent Andy Jassy KeynoteIt’s a different experience this year. The chat with my teammates is a mixture of discussion about new features and pictures of good times in Vegas from previous re:Invent conferences. Andy Jassy has finished the first keynote of 2020 and I was not disappointed. Lots of great new features that…AWS5 min readAWS5 min read
Nov 29, 2020re:Invent: Data Sessions Week 1Here is my list of sessions for week one of re:Invent focussed around data and analytics. How to use fully managed Jupyter notebooks in Amazon SageMaker What’s new with Amazon S3 How BMW Group uses AWS serverless analytics for a data-driven ecosystem Innovate faster with applications on AWS storage Embed…AWS2 min readAWS2 min read
Nov 14, 2020New Mac ConfigMy previous Mac was starting to overheat so it was swapped for another. I decided to install things as I required them rather than restore from a Time Machine backup as I thought I’d probably built up a lot of things that did not need over the last couple of…Mac2 min readMac2 min read
Jan 26, 2020AWS Lambda PostgreSQL ClientFor a while now the teams i’m working with are doing really exciting things with the PostgreSQL database. I’m sure there will be more to share on that soon! We’re running in the AWS cloud and the vast majority of the time we really like it. One minor gripe we…AWS5 min readAWS5 min read
May 29, 2019CDL: Visualising the power of data with Canvas and ElasticsearchI wrote a guest blog for Elastic (You Know, for Search). Here it is https://www.elastic.co/blog/cdl-visualising-the-power-of-data-with-canvas-and-elasticsearchElasticsearch1 min readElasticsearch1 min read
Apr 8, 2019Nest Hello UK SetupI’m a big fan of Nest products having installed them in a few properties over the years. The cameras in particular paid for themselves several times over as they captured footage of a lorry that crashed into my wall and drove off. Whilst most Nest products are very simple to…Internet Of Things3 min readInternet Of Things3 min read
