A Proposal for a new type of media source: “True News”

The November 2016 election has made me think about democracy, government, and our society in new ways for the first time in my life. One topic that seems to keep coming up is this idea of truth in the media.

I think most people would say they’d rather read news they know to be true than live in a fantasy world where they read news they like but which they know to be false. It’s basically an alternate take on the famous thought experiment, the Experience Machine, and comes to the same conclusion: truth matters.

In fact, truth may be the single-most important attribute of the news we read. And if you really start to think about it, truth becomes a really slippery concept.

Continue reading

Democracy 1.0

Whoever you voted for in the recent election, most people agree it was one of the most negative elections in their lifetime. People on both sides of the ballot used words like “disgusted”, “exhausted”, and “embittered” to describe their state of mind come November 8.

The candidate who won the electoral college lost the national popular vote. Hundreds of thousands of people have come out to protest that the winner is “not my president.” As a result of the election, virtually all levels of government will be controlled by Republicans, yet Democrats represent roughly 50% of the electorate.

And if that’s not enough, people’s trust in the media and the factual accuracy of the information they read is at an all-time low.

It seems to me Democracy 1.0 ain’t working out so well.

Actually, most Americans call the American system of government “democracy”, but even that term is loaded with nuance. Technically, the USA is a “federal presidential constitutional republic,” owing to the fact that it is a federation of states, that the people elect a president in a fair and free election, that the rights of all citizens are guaranteed by a founding constitution, and that the people do not directly vote on government matters (usually considered impractical), but rather elect representatives who do that for them.

For the rest of this blog post, I’ll just use the term “democracy 1.0” to mean all the above since it’s simpler and more in line with how people use the term in everyday conversation.

So is democracy 1.0 failing us? I think it is in some profound and interesting ways, and the point of writing this post is to explore how.

Continue reading

Thoughts from Ireland

This past week I had the pleasure of visiting my esteemed Gruntwork co-founder where he currently lives in Dublin, Ireland. I had a blast, it was awesome to work in person with Jim, and it was the first time I’ve been to Europe in about 15 years!

Sort of loos like Jim and I are opening a restaurant together. Not sure who the guy in the back is!

Sort of looks like Jim and I are opening a pizzeria together.

In theory, Irish culture and American culture aren’t much different. We both speak English as our primary language, we both eventually left the rule of the UK, and much of Ireland feels like a typical Western country. But there are some really interesting differences, too, and to make sure I don’t forget them, here they are!

Continue reading

My Talk on New AWS Services

I recently gave a talk to the AWS Phoenix Meetup on three new services and updates from AWS: the Application Load Balancer (ALB), EC2 Container Service (ECS), and Kinesis Analytics.

More than half the software teams I meet today run Docker in production, so there was high interest in how you can use the ALB with an ECS cluster to have a more streamlined docker cluster setup.

Some important details I since learned that are worth mentioning:

  1. The ALB’s costs scale with use. For example, if you have 1,000,000 idle web socket connections, you’ll pay $2,000/month! But presumably if you have 1,000,000 active users that kind of cost is ok. Thanks to nivertech on Hacker News for pointing this out.
  2. The ALB currently has a bug that impacts its ability to do zero-downtime deployments. Special credit to my colleague Yevgeniy Brikman for discovering and reporting this!

Check out the presentation on the Gruntwork Blog!

My Thoughts from DockerCon 2016

I just finished attending DockerCon 2016, and overall it was a pretty useful conference! I like to summarize what I learned both for my own mental clarity, and so others can benefit. So here we go.

How Many Different Ways Can You Deploy a Production Container Cluster?

I love Docker as a format for deploying things, but oh my gosh, how many different options are there for deploying it?

If you’re looking for “Heroku for Containers”, Docker has a pretty nice offering called Docker Cloud that seems really good. But once you’re ready to manage your own infrastructure, well, there was a long list to consider.

Continue reading

Introducing Gruntwork

In November 2014, I started helping software teams ramp up on Amazon Web Services and DevOps. This was gratifying work because a few years prior, I was involved in a project that did a terrible job of DevOps and suffered greatly for it. Now I was helping other teams avoid that same fate.

And what an adventure it turned out to be! I got the chance to work with Intel, Infusionsoft, 3-person startups, a well-funded Spotify competitor and so many other interesting companies doing interesting things. I called the consulting practice Phoenix DevOps because, well, I live in Phoenix, Arizona, and it turns out the concept of immutability (sometimes known as “Phoenix Servers”) is a central tenet of DevOps.

Along the way, I wrote A Comprehensive Guide to Building Scalable Web Apps on AWS, Part 1, and gave lots of DevOps presentations at various meetups and conferences.

During that time I also discovered the outstanding Blog of Yevgeniy Brikman (“Jim”). Jim mentioned one day he was looking for DevOps people and I loved his work, so I messaged him: “Hey, I do DevOps for lots of teams and have no time right now but let’s talk!”

It turned out Jim was doing consulting very similar to what I was doing through his own consulting practice, Atomic Squirrel. And after many conversations and trial projects, we decided we really liked working with each other.

As we compared all our experiences, we realized we’d basically been doing the same thing for every client. Setup a best-practices VPC, automate deployment, setup monitoring/metrics, get ramped up on AWS, etc.

Doing consulting on an hourly basis was one paradigm for helping clients solve these problems, but what if we could solve the problems really well one time and then consult with clients merely to help them adopt what was already built? That would mean we could significantly lower the cost and time needed to get your DevOps on.

Well, that’s what we’ve decided to do! And so today, it is my pleasure to announce that I am officially winding down Phoenix DevOps and joining with Yevgeniy Brikman in a new company we call Gruntwork.

Why call it Gruntwork? Because that’s what this work is for almost every software team. Whatever app you want to build, the infrastructure stands between your vision and your app; almost no one gets excited about automating their infrastructure. Not to mention that it’s hard to find DevOps engineers, they’re often expensive, and they hold all the keys to your kingdom. And when they leave, then what?

So Gruntwork is here to do your grunt work for you, and because of the way we’ve set things up, and the thousands of hours of collective experience we have, we can help you achieve a result that’s more effective and less expensive than the most amazing DevOps person you could hire.

One other aspect of Gruntwork that’s important to Jim and me is that Gruntwork has to be able to completely disappear and you should still be ok to run your infrastructure. Would I base my important project’s entire infrastructure on a new company that was just started by a couple of guys? Only if I had complete control of the source code and could run it without them.

So, unlike most businesses which strive to build lock-in to your product, we are actively striving to build “not lock-in”. It’s actually kind of hard to do sometimes, but it means that customers can choose to come back to us not because the cost of switching is so painful but because we continue to actively provide them value.

There’s more to share in the Gruntwork story, but I think that’s enough for now and we’ll announce more when we’re ready. In the meantime, I am thrilled to be working with Jim, who’s been a fantastic business partner so far, and I am thrilled to embark on this new adventure!

Thanks for reading. Now time to get some Gruntwork done…

Play Framework + Docker + CircleCI + AWS + EC2 Container Service

I was invited to speak earlier tonight at the Phoenix Java User’s Group on Play Framework, DevOps, and AWS.

I decided to do a basic walkthrough of Play Framework, and to build a continuous deployment pipeline live as part of the presentation. I wanted to actually implement something so that (a) I would be forced to pick specific technologies I could talk about, and (b) I could talk about the real-world challenges of implementing something.

I created 4 public GitHub repos to implement this:

Check out slide 36 for some directions on how to use all these items together, although I recognize the overall documentation may not be suitable for beginners since the presentation itself filled in the gaps in the slides. Enjoy!

My Talk on Choosing the Right Framework for Running Docker Containers in Production

I spoke today at Iterate.PHX, a DevOps conference put on right here in Phoenix, AZ.

My topic was on choosing the right framework for running docker containers in production. I specifically focus on the “multi-container VM” paradigm since if you’re OK to just run a single container per VM, then you don’t really need a framework at all. In that case, Docker is really just your deployment artifact.

The slides are below, and if there’s a video of the talk I’ll add that here as well. Enjoy!

A Common Pattern in Successful Companies

I’ve been helping software teams accelerate and succeed with DevOps and Amazon Web Services for a few months now (See Phoenix DevOps), and one of the more rewarding parts of the job is getting to observe how multiple different companies operate.

I’ve seen high-performing teams in companies that are about to IPO, software teams in Fortune 100 companies, startups of about 10 engineers, and software-based companies of no engineers at all! It’s been incredibly enlightening for me to learn about how people organize themselves to get sh*t done.

One of the other cool things about my line of work is that it’s right when companies are about to scale to the next level that they call me. So, for the most part, the companies I interact with, are successful startups on the verge of fast growth.

Now here’s the interesting pattern I see. I have yet to work with a single software team that doesn’t suffer some level of “embarrassment” about the state of their codebase, the “amateur” methods they used to get the job done, the duct tape they used here, or the total-makeshift-not-scalable solution they used there. It’s a really…unexpected combination: a business whose growth rate and product-market fit looks awesome, and whose product is filled with shortcomings.

Continue reading

A Simple Tool for Snapshotting Your EC2 Instances

TL;DR

I wrote a simple tool that makes it easy to create an AMI of your EC2 instance, and then to delete all AMI’s older than X days/hours/minutes with a single command. Check it out at https://github.com/josh-padnick/ec2-snapper.

This works especially well for backing up WordPress blogs hosted on a single instance in AWS.

Full Post

There are many ways to do backups in AWS. One of them is creating an Amazon Machine Image (AMI) of your EC2 Instance so that you have a moment-in-time backup which you can use to launch a new EC2 instance in minutes.

It’s not the world’s most robust backup method. First, in order to guarantee that your file system is consistent at the moment of your snapshot, you have to agree to reboot your instance. Second, if you’re backing up data where even a few minutes of data loss is a big deal, this solution isn’t for you.

But sometimes it’s actually the best solution.

Continue reading