We use systemd unit quite a bit. Getting dependencies correct can be tricky. We use systemd to start up Cloudurable Cassandra config scripts. We use systemd to start up Cassandra/Kafka, and to shut Cassandra/Kafka down nicely. Since systemd is pervasive in all new mainstream Linux distributions, you can see that systemd is an important concept for DevOps. We wrote this little example to try to understand how systemd dependencies work, and explain it to others.
Notes on Cassandra OS setup and optimizations for deploying in EC2/AWS Disk concerns These are important concepts for developers and DevOps who are responsible for developing Cassandra based applications and services. Cassandra writes to four areas commit logs SSTable an index file a bloom filter The compaction process of SSTable data makes heavy use of the disk. LeveledCompactionStrategy may need 10 to 20% overhead. SizeTieredCompactionStrategy worse case is 50% overhead needed to perform compaction.
Understanding what AWS provides for setting up private networks, security groups and more is important for anyone who calls themselves DevOps. AWS allows you to define a software defined network. You do this with Amazon Virtual Private Cloud (Amazon VPC). You can define subnets, ingress rules, security groups, NAT gateways, Internet gateways, and more. Amazon VPC A VPC is a virtual private cloud. You can create multiple Amazon VPCs within a region that spans multiple availability zones.
Understanding what AWS provides for backing up EBS volumes is an important concept for DevOps. Data safety with EBS - Backup/Recovery (Snapshots) Amazon EBS allows you to easily backup data. You do this by taking snapshots. Snapshots are point-in-time backups. Data written to an EBS volume can be periodically used to create a snapshot. Snapshots provide incremental backups of your data. Snapshots just saves the blocks that have changed. Only changed blocks since the last snapshot are saved in the new snapshot.
Understanding what AWS/EC2 provides for provisioning on-demand computing is essential for all DevOps. Amazon Elastic Compute Cloud (Amazon EC2) Amazon EC2 is AWS primary web service that provides resizable compute capacity in the cloud. EC2 Compute Compute is computational power needed for your use case. Amazon EC2 allows add compute resources through its Web Service API. EC2 allows you to launch instances. An instance is a server and you can install whatever software you need for your service or web application: NGINX, Apache httpd, Cassandra, Kafka, etc.
Getting the most bang for your buck with AWS Elastic Block Store (EBS) Understanding what AWS/EC2 provides for provisioning on-demand storage is critical for DevOps. Companies waste tons by over provisioning AWS. Amazon Elastic Block Store Amazon Web Services (AWS) provides Amazon Elastic Block Store (Amazon EBS) for EC2 instance storage. EBS is the virtual hard drives and SSDs for your servers running in the cloud. Amazon EBS volumes are automatically replicated, and it is easy to take snapshots of volumes to back them up in a known state.
Copyright © 2015 - 2020, Cloudurable™, all rights reserved.
Streamline your Cassandra Database, Apache Spark and Kafka DevOps in AWS.
SMACK/Lambda architecture consutling! Spark, Mesos, Akka, Cassandra and Kafka in AWS.
Apache Spark Training,
Kubernetes Security Training,
Akka Consulting,
AWS Cassandra Support,
Cassandra Training,
Kafka Training,
Cassandra Consulting,
Kafka Consulting,
Spark Training,
Spark Consulting,
Kafka Tutorial
Template by DevCows
