Skip to content

Script tools for setting up data analysis runs on AWS EC2 instances

License

Notifications You must be signed in to change notification settings

whitwort/AWSTools

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

41 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

AWSTools

This package contains a set of R tools designed to ease and automate deploying data analysis projects to AWS EC2 instances.

Getting started

To install this package from GitHub first make sure you have the devtools package installed, then run:

devtools::install_github('whitwort/AWSTools', build_vignettes = TRUE)

Now take a look at the Getting started tutorial, or open the vignette in R:

library(AWSTools)
vignette('getting-started')

This tutorial will walk you through setting up access to the AWS API, ssh keys, and a sample workflow.

Limitations

The goal for this package is to provide a highly simplified workflow for straightforward data analysis projects. See the paws package if you need a much more thorough AWS SDK for R.

These tools don't handle resource management or load balancing between instances so they are only suitable for projects where resource needs are easy to predict ahead of time. See a project like Slurm if you need a full featured job scheduler to manage a compute cluster.

Finally, this toolset has been developed and tested on EC2 instances running Amazon Linux 2, but it should work with any standard Linux distribution.

License

Copyright © 2022 Gregg Whitworth and licensed under GPLv3.

About

Script tools for setting up data analysis runs on AWS EC2 instances

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published