Scylla database clusters can be created and configured using the clusters.scylla.scylladb.com custom resource definition (CRD).
Please refer to the the user guide walk-through for deployment instructions. This page will explain all the available configuration options on the Scylla CRD.
apiVersion: scylla.scylladb.com/v1
kind: ScyllaCluster
metadata:
name: simple-cluster
namespace: scylla
spec:
version: 2.3.1
repository: scylladb/scylla
developerMode: true
cpuset: false
automaticOrphanedNodeCleanup: true
repairs:
- name: "weekly us-east-1 repair"
intensity: "2"
interval: "7d"
dc: ["us-east-1"]
backups:
- name: "daily users backup"
rateLimit: ["50"]
location: ["s3:cluster-backups"]
interval: "1d"
keyspace: ["users"]
- name: "weekly full cluster backup"
rateLimit: ["50"]
location: ["s3:cluster-backups"]
interval: "7d"
datacenter:
name: us-east-1
racks:
- name: us-east-1a
members: 3
storage:
capacity: 500G
storageClassName: local-raid-disks
resources:
requests:
cpu: 8
memory: 32Gi
limits:
cpu: 8
memory: 32Gi
placement:
nodeAffinity:
requiredDuringSchedulingIgnoredDuringExecution:
nodeSelectorTerms:
- matchExpressions:
- key: failure-domain.beta.kubernetes.io/region
operator: In
values:
- us-east-1
- key: failure-domain.beta.kubernetes.io/zone
operator: In
values:
- us-east-1a
tolerations:
- key: role
operator: Equal
value: scylla-clusters
effect: NoScheduleversion: The version of Scylla to use. It is used as the image tag to pull.agentVersion: The version of Scylla Manager Agent to use. It is used as the image tag to pull.repository: Optional field. Specifies a custom image repo. If left unset, the official docker hub repo is used (scylladb/scylla).agentRepository: Optional field. Specifies a custom Scylla Manager Agent image repo. If left unset, the official docker hub repo is used (scylladb/scylla).developerMode: Optional field. If it's true, then Scylla is started in developer mode. This setting is for shared test/dev environments.cpuset: Optional field. If it's true, then the operator will start Scylla with cpu pinning for maximum performance. For this to work, you need to set the kubelet to use the static cpu policy and only specify limits in resources.automaticOrphanedNodeCleanup: Optional field. Controls if automatic orphan node cleanup should be performed.alternator: Optional field. Defines Alternator configuration.port: Port on which to bind to Alternator API.writeIsolation: required Desired write isolation.
genericUpgrade: Optional field. Defines GenericUpgrade configuration.failureStrategy: specifies which logic is executed when upgrade failure happens. Currently onlyRetryis supported.pollInterval: specifies how often upgrade logic polls on state updates. Increasing this value should lower number of requests sent to the kube-apiserver, but it may affect overall time spent during upgrade.
datacenter: Datacenter definition.sysctls: Optional field. Sysctl properties to be applied during initialization.scyllaArgs: Optional field. Command line argument passed to Scylla container image. Note: not all Scylla versions support it.network: Optional field. Allows to customize network parameters.hostNetworking: controls if host networking should be enabled.dnsPolicy: controls Scylla Pod DNS Policy. See details.
repairs: Optional field. Repair tasks definitions. SeeScylla Manager settingsfor details.backups: Optional field. Repair tasks definitions. SeeScylla Manager settingsfor details.
In the Scylla model, each cluster contains datacenters and each datacenter contains racks. At the moment, the operator only supports single datacenter setups.
Tasks are scheduled only when Scylla Manager is deployed in K8s cluster.
Repairs:
name- required - human readable name of the task. It must be unique across all tasks.startDate- specifies the task start date expressed in the RFC3339 format ornow[+duration], e.g.now+3d2h10m, valid units are d, h, m, s (default "now").interval- Optional field. Task schedule interval e.g.3d2h10m, valid units are d, h, m, s (default "0").numRetries- Optional field. The number of times a scheduled task will retry to run before failing (default 3).dc- Optional field. A list of datacenter glob patterns, e.g.["dc1", "!otherdc*"]used to specify the DCs to include or exclude from backup.failFast- Optional field. Stop repair on first error.intensity- Optional field. Specifies how many token ranges (per shard) to repair in a single Scylla repair job. By default this is 1. If you set it to 0 the number of token ranges is adjusted to the maximum supported by node (see max_repair_ranges_in_parallel in Scylla logs). Valid values are 0 and integers >= 1. Higher values will result in increased cluster load and slightly faster repairs. Changing the intensity impacts repair granularity if you need to resume it, the higher the value the more work on resume. For Scylla clusters that do not support row-level repair, intensity can be a decimal between (0,1). In that case it specifies percent of shards that can be repaired in parallel on a repair master node. For Scylla clusters that are row-level repair enabled, setting intensity below 1 has the same effect as setting intensity 1. Intensity is a number passed as string due to lack of support for float values in k8s controller runtimeparallel- Optional field. Specifies the maximum number of Scylla repair jobs that can run at the same time (on different token ranges and replicas). Each node can take part in at most one repair at any given moment. By default the maximum possible parallelism is used. The effective parallelism depends on a keyspace replication factor (RF) and the number of nodes. The formula to calculate it is as follows: number of nodes / RF, ex. for 6 node cluster with RF=3 the maximum parallelism is 2.keyspace- Optional field. A list of keyspace/tables glob patterns, e.g.["keyspace", "!keyspace.table_prefix_*"]used to include or exclude keyspaces from repair.smallTableThreshold- Optional field. Enable small table optimization for tables of size lower than given threshold. Supported units[B, MiB, GiB, TiB](default"1GiB").
Backups:
name- required - human readable name of the task. It must be unique across all tasks.startDate- Optional field. Specifies the task start date expressed in the RFC3339 format ornow[+duration], e.g.now+3d2h10m, valid units are d, h, m, s (default "now").interval- Optional field. task schedule interval e.g.3d2h10m, valid units are d, h, m, s (default "0").numRetries- Optional field. the number of times a scheduled task will retry to run before failing (default 3).dc- Optional field. A list of datacenter glob patterns, e.g.["dc1","!otherdc*"]used to specify the DCs to include or exclude from backup.keyspace- Optional field. A list of keyspace/tables glob patterns, e.g.["keyspace","!keyspace.table_prefix_*"]used to include or exclude keyspaces from backup.location- Optional field. A list of backup locations in the format[<dc>:]<provider>:<name>ex.s3:my-bucket. The<dc>:part is optional and is only needed when different datacenters are being used to upload data to different locations.<name>Optional field. must be an alphanumeric string and may contain a dash and or a dot, but other characters are forbidden. The only supported storage at the moment ares3andgcs.rateLimit- Optional field. A list of megabytes (MiB) per second rate limits expressed in the format[<dc>:]<limit>. The<dc>:part is optional and only needed when different datacenters need different upload limits. Set to 0 for no limit (default 100).retention- Optional field. The number of backups which are to be stored (default 3).snapshotParallel- Optional field. A list of snapshot parallelism limits in the format[<dc>:]<limit>. The<dc>:part is optional and allows for specifying different limits in selected datacenters. If The<dc>:part is not set, the limit is global (e.g.["dc1:2,5"]) the runs are parallel in n nodes (2 in dc1) and n nodes in all the other datacenters.uploadParallel- Optional field. A list of upload parallelism limits in the format[<dc>:]<limit>. The<dc>:part is optional and allows for specifying different limits in selected datacenters. If The<dc>:part is not set the limit is global (e.g.["dc1:2,5"]) the runs are parallel in n nodes (2 in dc1) and n nodes in all the other datacenters.
name: Name of the datacenter. Usually, a datacenter corresponds to a region.racks: List of racks for the specific datacenter.
name: Name of the rack. Usually, a rack corresponds to an availability zone.members: Number of Scylla members for the specific rack. (In Scylla documentation, they are called nodes. We don't call them nodes to avoid confusion as a Scylla Node corresponds to a Kubernetes Pod, not a Kubernetes Node).storage: Defines the specs of the underlying storage.capacity: Capacity of the PersistentVolume to request.storageClassName: Optional field. StorageClass of PersistentVolume to request.
resources: Defines the CPU and RAM resources for the Scylla Pods.requests: The minimum amount of resources needed to run a Scylla container.cpu: CPU requests.memory: RAM requests.
limits: The maximum amount of resources that can be used by a Scylla container.cpu: CPU limits.memory: RAM limits.
agentResources: Optional field. Defines the CPU and RAM resources for the Scylla Manager Agent container. Seeresourcesfor details.volumes: Optional field. Defines volumes available in Scylla Pod. See details.volumeMounts: Optional field. Defines which volumes will be attached to Scylla container.agentVolumeMounts: Optional field. Defines which volumes will be attached to Agent container.scyllaConfig: Optional field. name of custom config map which will be merged with Scylla config.scyllaAgentConfig: Optional field. name of custom secret which will be merged with Scylla Manager Agent config.placement: Optional field. Defines the placement of Scylla Pods. Has the following subfields: