I haven’t posted to this blog in awhile, but that’s mainly because it’s been a crazy first half of the year. I’ve started a new job as a cloud architect and serverless community advocate at Trek10, moved to a new state, and put time into some exciting side projects. I was also named an AWS Serverless Hero a few days ago. This is a new program that recognizes AWS community leaders in the specific area of serverless applications, and is already helping me to meet and help more people on their cloud journey.
Most of my technical writing is now appearing either at Trek10 or at A Cloud Guru. The “FaaS and Furious” cartoon series is going strong and can be found via A Cloud Guru’s social media channels.
I also originated and have been co-hosting the Think FaaS podcast to help educate the serverless community. The episodes are short and fluff-free, so why not subscribe?
Yesterday one of my short fiction pieces — the first of several — appeared at Daily Science Fiction, a professional SFWA-qualifying publication. This is part of a larger project that I hope to share more about at the end of the year.
Upcoming Speaking Events
July 17th – “DEV12 – Living On The Edge with AWS Greengrass” – AWS Summit NYC
I’ll be speaking in the Dev Lounge at the AWS NYC Summit. Come for the Greengrass war stories, stay for the soon-to-be-infamous IoT Rap.
July 30-August 1st – ServerlessConf San Francisco
I’ll be heavily involved in this year’s ServerlessConf. Here’s my tentative agenda:
- July 30: Leading an all-day serverless workshop
- July 31: Hosting the main talk track
- Aug 1: Joint talk with Jared Short: “How To Win Coworkers and Influence Organizations for Serverless”
The Think FaaS podcast will also be featured live on both days of the main conference with an excellent lineup of guest speakers. I hope to see you there!
September 8th – “Serverless for the Enterprise” – IT Weekend Ukraine
Looking forward to sharing some serverless best practices at one of Eastern Europe’s largest IT events.
Welcome to “Serverless Superheroes”. In this space, I chat with the innovators, toolmakers, and developers who are navigating the brave new world of “serverless” cloud applications. For today’s edition, I chatted with Adam Johnson, the cofounder of IOpipe. The following interview has been edited and condensed for clarity.
Continue reading “SERVERLESS SUPERHEROES: Adam Johnson, Monitoring, and the “No Ops” Myth”
I had the great privilege of speaking at ServerlessConf in Austin a couple of weeks ago. The conference is a community event run by the fine folks at A Cloud Guru, but you’d never know that they do other things with their time besides plan conferences, because the logistics were practically flawless. Perfect size (about 400 attendees), great food and a cool venue near downtown Austin made for a fun couple of days. Both the quality of sessions and the technical chops of attendees seemed exceptionally high, leading to lots of thought-provoking content and productive hallway conversations. The only negative comment I have about the event was the pacing – the organizers found a way to cram forty sessions into just two days, and the human brain can only absorb so much information before starting to check out.
Fortunately, all the sessions are now available on YouTube for further review. Here are my top five takeaways from the conference, as well as a few of my favorite sessions.
1. In the land of “No Ops”, ops is still king
Creating an app with serverless technologies is superficially easy, but actually deploying, testing, monitoring and debugging that app in production can be a nightmare. Without insight into the underlying services, you have less control over what breaks and less ability to fix it, and the ecosystem of tools that might help is still pretty thin. Nobody puts their finger better on this problem than DevOps legend Charity Majors, whose session was a rambling, electrifying rant on the folly of assuming that “going serverless” means you don’t have to think about traditional ops considerations anymore. If anything, getting rid of the in-house ops team removes the veil between developers and their own code: if something you wrote stops working in production, you’d better be prepared to fix it yourself. Unless you’ve hit a problem in the underlying services, in which case your app is completely beholden to somebody else’s dev cycle – a very real possibility that is not to be brushed off lightly.
Continue reading “5 Takeaways from ServerlessConf”
AWS Lambda functions can only run for a maximum of five minutes. This must be distinctly understood, or nothing wonderful can come of the story you are about to hear.
This past summer, my team and I set out to build an internal software system used for deployment testing on AWS. The application would run a large number of workflow executions in parallel each night and might perform a few one-off executions during the day – maybe six hours total use out of every twenty-four, with only a small fraction of that time spent doing actual compute tasks. Trying to scale, manage and spend money on EC2 instances for that workload didn’t interest us. We wanted to run our whole workflow process end-to-end on AWS Lambda.
And we did. Heaven help us, we did. This is our story.
Continue reading “Serverless Workflows on AWS: My Journey From SWF to Step Functions”
The AWS Price List API
In December 2015, AWS announced a new Price List API that exposes access to current prices for several of their products, including EC2 and RDS. If you’re thinking about building some automation to track AWS spend, and you’re used to working with AWS’s generally marvelous APIs and language SDKs, this sounds like great news. At least, that’s what I thought when I sat down last week to build a tool that would track cost savings for stopped EC2 instances in some of my company’s AWS environments.
Let’s just say the Price List API didn’t match my initial expectations. In fact, calling it an “API” is a bit generous; basically it’s a giant JSON or CSV file you can download for various AWS services that contains price and product data indexed by SKU.
What’s a SKU, you ask? The short answer is it’s a “Stock Keeping Unit“; the even shorter answer is that it doesn’t matter, because nowhere else in the AWS API ecosystem are SKUs for individual resources made available, so you’re not going to be cross-referencing them with anything else. But don’t despair; it is in fact possible to automate price lookups inside the AWS Price List data dump. Let me walk you through the approach I used.
Continue reading “Adventures in AWS: Understanding the Price List API”
The open source Serverless project, which currently has nearly 10,000 stars on Github, provides tooling around AWS’s “Function as a Service” ecosystem that includes Lambda and API Gateway. I recently had the opportunity to chat with Florian Motlik, CTO of Serverless, about his thoughts on serverless architectures and the future of the Serverless framework.
The following interview has been edited and condensed.
Forrest: Although AWS Lambda is less than two years old, we’re already seeing a robust tooling ecosystem appear around it, including the Serverless Framework. How did the Serverless project get started?
Florian: Austen Collins, our founder, started Serverless about a year ago. In his previous life as a consultant, he worked with AWS Lambda while building various applications. Austen saw two things about Lambda that made a huge difference for him. First, it enables you to build applications without having to maintain infrastructure. And as someone who had to maintain infrastructure in the past, he saw that was a really interesting direction for the industry to go. Second, Lambda enables an event-driven architecture, where you just react to events that can be fired from anywhere to anywhere. Austen also saw that although Lambda was very powerful, its lack of tooling made it hard for new users to get started. So, about a year ago he started building the Serverless framework. The project took off right away, and towards the end of last year, he decided that this is not just an open source framework; it’s something we can build a company around. So that’s when I was brought on as the CTO to lead our engineering team, and we grew from there.
Continue reading “Lambda calculus: talking Serverless with Florian Motlik”
Pester and CI
If you’re doing Windows scripting in 2016, you’d better be using PowerShell. And if you’re writing PowerShell scripts, you’d better be checking them into source control and covering them with Pester tests.
It turns out that you can do more with Pester than just run tests manually at the console. As part of a continuous integration (CI) process, you may want to invoke Pester tests on a remote server and report the results up through the build chain. Handily, you can export Pester test output in an NUnit XML format that modern CI systems like Jenkins understand.
But what if you’re not using a build server to invoke Pester? What if your CI setup is … dun dun dun … “serverless”?
Continue reading “Invoke Pester Tests Serverlessly with AWS Lambda and SSM”