Python Gherkin Other
Switch branches/tags
Latest commit 276e6bd Oct 24, 2017 @solarkennedy solarkennedy Merge pull request #1574 from Yelp/fix_1565
Allow deployd to handle the case where a service is not configured. F…
Permalink
Failed to load latest commit information.
debian Released 0.67.18 via make release Oct 23, 2017
docs/source Fix typo in docs Sep 27, 2017
example_cluster revert marathon port changes, add .get to config class Oct 19, 2017
general_itests Merge branch 'master' of github.com:Yelp/paasta into mypy Aug 28, 2017
paasta_itests revert marathon port changes, add .get to config class Oct 19, 2017
paasta_tools Merge pull request #1574 from Yelp/fix_1565 Oct 23, 2017
tests Merge pull request #1560 from Yelp/filter-nonexistant-agents-from-clu… Oct 23, 2017
yelp_package Released 0.67.18 via make release Oct 23, 2017
.coveragerc gevent proof of concept for the service autoscaling Mar 21, 2017
.dockerignore Run the api server in the itests, at http://paasta_api:5054 Jun 30, 2017
.github_changelog_generator Added automatic changelog Nov 20, 2015
.gitignore Add mypy pre-commit hook and fix some files for it. Aug 2, 2017
.pre-commit-config.yaml Upgrade pre-commit and migrate to pygrep Oct 6, 2017
.travis.yml Upgrade pre-commit and migrate to pygrep Oct 6, 2017
CHANGELOG.md Released 0.67.12 via make release Oct 6, 2017
LICENSE Upgrade pre-commit and hooks Jul 13, 2017
MANIFEST.in Switch from package_data to manifest file Jun 20, 2017
Makefile Makefile to python3 Jul 12, 2017
README.md Add my OSCON presentation to the README Jul 14, 2016
build-manpages.sh We need to set +u for the venv due to an unset PS1 Mar 28, 2017
comparison.md Switch from readthedocs.org->readthedocs.io Apr 27, 2016
extra-linux-requirements.txt Only install pyinotify on linux May 4, 2017
mypy.ini Make mypy pass on setup_marathon_job and test_setup_marathon_job Oct 10, 2017
readthedocs.yml Make requirements-dev.txt include requirements.txt May 27, 2016
requirements-dev.txt Upgrade pre-commit and migrate to pygrep Oct 6, 2017
requirements.txt Bump up taskproc Oct 20, 2017
setup.py add paasta_broadcast_log script Oct 16, 2017
tox.ini Merge pull request #1534 from Yelp/sharded_itests Oct 16, 2017

README.md

Build Status Coverage Status Download

PaaSTA - Build, Deploy, Connect, and Monitor Services

PaaSTA Logo

PaaSTA is a highly-available, distributed system for building, deploying, and running services using containers and Apache Mesos!

Want to know more about the opinions behind what makes PaaSTA special? Check out the PaaSTA Principles.

Note: PaaSTA has been running in production at Yelp for more than a year, and has a number of "Yelpisms" still lingering in the codebase. We have made efforts to excise them, but there are bound to be lingering issues. Please help us by opening an issue or better yet a pull request.

Components

Note: PaaSTA is an opinionated platform that uses a few un-opinionated tools. It requires a non-trivial amount of infrastructure to be in place before it works completely:

  • Docker for code delivery and containment
  • Mesos for code execution and scheduling (runs Docker containers)
  • Marathon for managing long-running services
  • Chronos for running things on a timer (nightly batches)
  • SmartStack for service registration and discovery
  • Sensu for monitoring/alerting
  • Jenkins (optionally) for continuous deployment

The main advantage to having a PaaS composed of components like these is you get to reuse them for other purposes. For example at Yelp Sensu is not just for PaaSTA, it can be used to monitor all sorts of things. Also Mesos can be re-used for things like custom frameworks. For example at Yelp we use the Mesos infrastructure to run our large-scale testing framework: Seagull. SmartStack is used at Yelp for service discovery for Non-PaaSTA things as well, like databases, legacy apps, and Puppet-defined apps. Most PaaS's do not allow for this type of component re-use.

On the other hand, requiring lots of components means lots of infrastructure to setup before PaaSTA is fully baked. If you are looking for a project that doesn't require external components, we encourage you to look at the doc comparing PaaSTA to other tools.

Design Goals

  • Declarative, rather than imperative, control
  • Fault tolerance
  • Service isolation
  • Efficient use of resources
  • No single points of failure
  • Pleasant interface

PaaSTA is an opinionated platform, and it is not designed to interoperate with every possible backend service out there.

Think of it as an example of how we have integrated these technologies together to build a cohesive PaaS. It is not a turn-key PaaS solution.

Getting Started

See the getting started documentation for how to deploy PaaSTA.

Documentation

Read the documentation at Read the Docs.

Videos / Talks About PaaSTA

License

PaaSTA is licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0

Contributing

Everyone is encouraged to contribute to PaaSTA by forking the Github repository and making a pull request or opening an issue. You can also join #paasta on irc.freenode.net to discuss PaaSTA with other users.