404
+Page not found :(
+The requested page could not be found.
+diff --git a/.nojekyll b/.nojekyll new file mode 100644 index 00000000..e69de29b diff --git a/404.html b/404.html new file mode 100644 index 00000000..e3a0aa66 --- /dev/null +++ b/404.html @@ -0,0 +1,93 @@ + + +
+ + + +Page not found :(
+The requested page could not be found.
+This is the base Jekyll theme. You can find out more info about customizing your Jekyll theme, as well as basic Jekyll usage documentation at jekyllrb.com
+ +You can find the source code for Minima at GitHub: +jekyll / +minima
+ +You can find the source code for Jekyll at GitHub: +jekyll / +jekyll
+ diff --git a/assets/css/custom.css b/assets/css/custom.css new file mode 100644 index 00000000..2ade2325 --- /dev/null +++ b/assets/css/custom.css @@ -0,0 +1,48 @@ +.tab { + display: flex; + flex-wrap: wrap; + margin-left: -20px; + padding: 0; + list-style: none; + position: relative; +} + +.tab > * { + flex: none; + padding-left: 20px; + position: relative; +} + +.tab > * > a { + display: block; + text-align: center; + padding: 9px 20px; + color: #999; + border-bottom: 2px solid transparent; + border-bottom-color: transparent; + font-size: 12px; + text-transform: uppercase; + transition: color .1s ease-in-out; + line-height: 20px; +} + +.tab > .active > a { + color:#222; + border-color: #1e87f0; +} + +.tab > li > a { + text-decoration: none; + cursor: pointer; +} + +.tab-content { + padding: 0; +} + +.tab-content > li { + display: none; +} +.tab-content > li.active { + display: initial; +} \ No newline at end of file diff --git a/assets/css/style.css b/assets/css/style.css new file mode 100644 index 00000000..2269665a --- /dev/null +++ b/assets/css/style.css @@ -0,0 +1 @@ +/*! normalize.css v3.0.2 | MIT License | git.io/normalize */@import url("https://fonts.googleapis.com/css?family=Open+Sans:400,700&display=swap");html{font-family:sans-serif;-ms-text-size-adjust:100%;-webkit-text-size-adjust:100%}body{margin:0}article,aside,details,figcaption,figure,footer,header,hgroup,main,menu,nav,section,summary{display:block}audio,canvas,progress,video{display:inline-block;vertical-align:baseline}audio:not([controls]){display:none;height:0}[hidden],template{display:none}a{background-color:transparent}a:active,a:hover{outline:0}abbr[title]{border-bottom:1px dotted}b,strong{font-weight:bold}dfn{font-style:italic}h1{font-size:2em;margin:0.67em 0}mark{background:#ff0;color:#000}small{font-size:80%}sub,sup{font-size:75%;line-height:0;position:relative;vertical-align:baseline}sup{top:-0.5em}sub{bottom:-0.25em}img{border:0}svg:not(:root){overflow:hidden}figure{margin:1em 40px}hr{box-sizing:content-box;height:0}pre{overflow:auto}code,kbd,pre,samp{font-family:monospace, monospace;font-size:1em}button,input,optgroup,select,textarea{color:inherit;font:inherit;margin:0}button{overflow:visible}button,select{text-transform:none}button,html input[type="button"],input[type="reset"],input[type="submit"]{-webkit-appearance:button;cursor:pointer}button[disabled],html input[disabled]{cursor:default}button::-moz-focus-inner,input::-moz-focus-inner{border:0;padding:0}input{line-height:normal}input[type="checkbox"],input[type="radio"]{box-sizing:border-box;padding:0}input[type="number"]::-webkit-inner-spin-button,input[type="number"]::-webkit-outer-spin-button{height:auto}input[type="search"]{-webkit-appearance:textfield;box-sizing:content-box}input[type="search"]::-webkit-search-cancel-button,input[type="search"]::-webkit-search-decoration{-webkit-appearance:none}fieldset{border:1px solid #c0c0c0;margin:0 2px;padding:0.35em 0.625em 0.75em}legend{border:0;padding:0}textarea{overflow:auto}optgroup{font-weight:bold}table{border-collapse:collapse;border-spacing:0}td,th{padding:0}.highlight table td{padding:5px}.highlight table pre{margin:0}.highlight .cm{color:#999988;font-style:italic}.highlight .cp{color:#999999;font-weight:bold}.highlight .c1{color:#999988;font-style:italic}.highlight .cs{color:#999999;font-weight:bold;font-style:italic}.highlight .c,.highlight .cd{color:#999988;font-style:italic}.highlight .err{color:#a61717;background-color:#e3d2d2}.highlight .gd{color:#000000;background-color:#ffdddd}.highlight .ge{color:#000000;font-style:italic}.highlight .gr{color:#aa0000}.highlight .gh{color:#999999}.highlight .gi{color:#000000;background-color:#ddffdd}.highlight .go{color:#888888}.highlight .gp{color:#555555}.highlight .gs{font-weight:bold}.highlight .gu{color:#aaaaaa}.highlight .gt{color:#aa0000}.highlight .kc{color:#000000;font-weight:bold}.highlight .kd{color:#000000;font-weight:bold}.highlight .kn{color:#000000;font-weight:bold}.highlight .kp{color:#000000;font-weight:bold}.highlight .kr{color:#000000;font-weight:bold}.highlight .kt{color:#445588;font-weight:bold}.highlight .k,.highlight .kv{color:#000000;font-weight:bold}.highlight .mf{color:#009999}.highlight .mh{color:#009999}.highlight .il{color:#009999}.highlight .mi{color:#009999}.highlight .mo{color:#009999}.highlight .m,.highlight .mb,.highlight .mx{color:#009999}.highlight .sb{color:#d14}.highlight .sc{color:#d14}.highlight .sd{color:#d14}.highlight .s2{color:#d14}.highlight .se{color:#d14}.highlight .sh{color:#d14}.highlight .si{color:#d14}.highlight .sx{color:#d14}.highlight .sr{color:#009926}.highlight .s1{color:#d14}.highlight .ss{color:#990073}.highlight .s{color:#d14}.highlight .na{color:#008080}.highlight .bp{color:#999999}.highlight .nb{color:#0086B3}.highlight .nc{color:#445588;font-weight:bold}.highlight .no{color:#008080}.highlight .nd{color:#3c5d5d;font-weight:bold}.highlight .ni{color:#800080}.highlight .ne{color:#990000;font-weight:bold}.highlight .nf{color:#990000;font-weight:bold}.highlight .nl{color:#990000;font-weight:bold}.highlight .nn{color:#555555}.highlight .nt{color:#000080}.highlight .vc{color:#008080}.highlight .vg{color:#008080}.highlight .vi{color:#008080}.highlight .nv{color:#008080}.highlight .ow{color:#000000;font-weight:bold}.highlight .o{color:#000000;font-weight:bold}.highlight .w{color:#bbbbbb}.highlight{background-color:#f8f8f8}*{box-sizing:border-box}body{padding:0;margin:0;font-family:"Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif;font-size:16px;line-height:1.5;color:#606c71}#skip-to-content{height:1px;width:1px;position:absolute;overflow:hidden;top:-10px}#skip-to-content:focus{position:fixed;top:10px;left:10px;height:auto;width:auto;background:#e19447;outline:thick solid #e19447}a{color:#1e6bb8;text-decoration:none}a:hover{text-decoration:underline}.btn{display:inline-block;margin-bottom:1rem;color:rgba(255,255,255,0.7);background-color:rgba(255,255,255,0.08);border-color:rgba(255,255,255,0.2);border-style:solid;border-width:1px;border-radius:0.3rem;transition:color 0.2s, background-color 0.2s, border-color 0.2s}.btn:hover{color:rgba(255,255,255,0.8);text-decoration:none;background-color:rgba(255,255,255,0.2);border-color:rgba(255,255,255,0.3)}.btn+.btn{margin-left:1rem}@media screen and (min-width: 72rem){.btn{padding:0.75rem 1rem}}@media screen and (min-width: 42rem) and (max-width: 72rem){.btn{padding:0.6rem 0.9rem;font-size:0.9rem}}@media screen and (max-width: 42rem){.btn{display:block;width:100%;padding:0.75rem;font-size:0.9rem}.btn+.btn{margin-top:1rem;margin-left:0}}.page-header{color:#fff;text-align:center;background-color:#159957;background-image:linear-gradient(120deg, #155799, #159957)}@media screen and (min-width: 72rem){.page-header{padding:5rem 6rem}}@media screen and (min-width: 42rem) and (max-width: 72rem){.page-header{padding:3rem 4rem}}@media screen and (max-width: 42rem){.page-header{padding:2rem 1rem}}.project-name{margin-top:0;margin-bottom:0.1rem}@media screen and (min-width: 72rem){.project-name{font-size:3.25rem}}@media screen and (min-width: 42rem) and (max-width: 72rem){.project-name{font-size:2.25rem}}@media screen and (max-width: 42rem){.project-name{font-size:1.75rem}}.project-tagline{margin-bottom:2rem;font-weight:normal;opacity:0.7}@media screen and (min-width: 72rem){.project-tagline{font-size:1.25rem}}@media screen and (min-width: 42rem) and (max-width: 72rem){.project-tagline{font-size:1.15rem}}@media screen and (max-width: 42rem){.project-tagline{font-size:1rem}}.main-content{word-wrap:break-word}.main-content :first-child{margin-top:0}@media screen and (min-width: 72rem){.main-content{max-width:64rem;padding:2rem 6rem;margin:0 auto;font-size:1.1rem}}@media screen and (min-width: 42rem) and (max-width: 72rem){.main-content{padding:2rem 4rem;font-size:1.1rem}}@media screen and (max-width: 42rem){.main-content{padding:2rem 1rem;font-size:1rem}}.main-content kbd{background-color:#fafbfc;border:1px solid #c6cbd1;border-bottom-color:#959da5;border-radius:3px;box-shadow:inset 0 -1px 0 #959da5;color:#444d56;display:inline-block;font-size:11px;line-height:10px;padding:3px 5px;vertical-align:middle}.main-content img{max-width:100%}.main-content h1,.main-content h2,.main-content h3,.main-content h4,.main-content h5,.main-content h6{margin-top:2rem;margin-bottom:1rem;font-weight:normal;color:#159957}.main-content p{margin-bottom:1em}.main-content code{padding:2px 4px;font-family:Consolas, "Liberation Mono", Menlo, Courier, monospace;font-size:0.9rem;color:#567482;background-color:#f3f6fa;border-radius:0.3rem}.main-content pre{padding:0.8rem;margin-top:0;margin-bottom:1rem;font:1rem Consolas, "Liberation Mono", Menlo, Courier, monospace;color:#567482;word-wrap:normal;background-color:#f3f6fa;border:solid 1px #dce6f0;border-radius:0.3rem}.main-content pre>code{padding:0;margin:0;font-size:0.9rem;color:#567482;word-break:normal;white-space:pre;background:transparent;border:0}.main-content .highlight{margin-bottom:1rem}.main-content .highlight pre{margin-bottom:0;word-break:normal}.main-content .highlight pre,.main-content pre{padding:0.8rem;overflow:auto;font-size:0.9rem;line-height:1.45;border-radius:0.3rem;-webkit-overflow-scrolling:touch}.main-content pre code,.main-content pre tt{display:inline;max-width:initial;padding:0;margin:0;overflow:initial;line-height:inherit;word-wrap:normal;background-color:transparent;border:0}.main-content pre code:before,.main-content pre code:after,.main-content pre tt:before,.main-content pre tt:after{content:normal}.main-content ul,.main-content ol{margin-top:0}.main-content blockquote{padding:0 1rem;margin-left:0;color:#819198;border-left:0.3rem solid #dce6f0}.main-content blockquote>:first-child{margin-top:0}.main-content blockquote>:last-child{margin-bottom:0}.main-content table{display:block;width:100%;overflow:auto;word-break:normal;word-break:keep-all;-webkit-overflow-scrolling:touch}.main-content table th{font-weight:bold}.main-content table th,.main-content table td{padding:0.5rem 1rem;border:1px solid #e9ebec}.main-content dl{padding:0}.main-content dl dt{padding:0;margin-top:1rem;font-size:1rem;font-weight:bold}.main-content dl dd{padding:0;margin-bottom:1rem}.main-content hr{height:2px;padding:0;margin:1rem 0;background-color:#eff0f1;border:0}.site-footer{padding-top:2rem;margin-top:2rem;border-top:solid 1px #eff0f1}@media screen and (min-width: 72rem){.site-footer{font-size:1rem}}@media screen and (min-width: 42rem) and (max-width: 72rem){.site-footer{font-size:1rem}}@media screen and (max-width: 42rem){.site-footer{font-size:0.9rem}}.site-footer-owner{display:block;font-weight:bold}.site-footer-credits{color:#819198}.main-content h2{color:#c9208a}.main-content h1{color:#c9208a}body{color:#232F3E}.menu-bar{margin-left:auto;margin-right:auto;display:flex;align-items:center;justify-content:flex-start}.menu-background{position:fixed;left:0;right:0;top:0;z-index:9999}.menu-background-berry{background-color:#504bab}nav a{text-decoration:none}nav ul{list-style:none;margin:0;padding-left:0}nav li{color:#f1f3f3;display:block;float:left;padding:0.7rem;position:relative;text-decoration:none;transition-duration:0.5s}nav li a{color:#f1f3f3}nav li:hover,nav li:focus-within{color:#d4dada;cursor:pointer;transition-duration:0.5s}nav li:focus-within a{outline:none;color:#d4dada;text-decoration:none}nav li:hover a{color:#d4dada;transition-duration:0.5s;text-decoration:none}nav ul li:hover ul li a{color:#232F3E;transition-duration:0.5s;text-decoration:none}nav ul li:hover ul li:hover a{color:#d4dada;transition-duration:0.5s;text-decoration:none}nav ul li ul{background:#262262;visibility:hidden;opacity:0;min-width:5rem;position:absolute;transition:all 0.5s ease;margin-top:1rem;left:0;display:none}nav ul li:hover>ul,nav ul li:focus-within>ul,nav ul li ul:hover,nav ul li ul:focus{visibility:visible;opacity:1;display:block;animation:fadeIn linear 0.25s;-webkit-animation:fadeIn linear 0.25s;-moz-animation:fadeIn linear 0.25s;-o-animation:fadeIn linear 0.25s;-ms-animation:fadeIn linear 0.25s}.nav-title{font-weight:500;font-size:1rem}.nav-item{font-weight:400;font-size:0.9rem}@keyframes fadeIn{0%{opacity:0}100%{opacity:1}}@-moz-keyframes fadeIn{0%{opacity:0}100%{opacity:1}}@-webkit-keyframes fadeIn{0%{opacity:0}100%{opacity:1}}@-o-keyframes fadeIn{0%{opacity:0}100%{opacity:1}}@-ms-keyframes fadeIn{0%{opacity:0}100%{opacity:1}}nav ul li ul li{clear:both;width:100%}.default-content-margin-top{margin-top:48px}.page-header{padding-top:5rem;background-color:#504bab;background-image:none;color:#f1f3f3;text-align:start}.page-header h1{margin-top:-12px;margin-bottom:0}.page-header h3{margin-bottom:0}.title-container{display:flex;flex-direction:column;margin-left:3rem}.image-container{width:10%}.header-container{display:flex;align-items:flex-start;flex-wrap:nowrap;margin-top:1rem;margin-bottom:1rem}.main-areas{display:flex;justify-content:space-around;align-items:stretch}a.box-link{text-decoration:none;color:#c9208a}.box{border:solid 1px #c9208a;border-top-width:0;flex:1;display:flex;flex-direction:column;position:relative;margin-left:1rem;margin-right:1rem}.box h3{margin-top:0;color:#c9208a}.box h5{margin-top:1rem;color:#c9208a}.box-content{text-align:center;padding:1rem}.box-top{border:solid 1px #c9208a;width:100%;height:4px;background-color:#c9208a}.icon{height:90px;width:90px}.btn-div{margin-top:1rem}.button-container{display:flex;align-items:center}.button-item{margin-right:10px;display:flex;flex-direction:row}.header-actions{margin-top:1rem}.header-actions a{text-decoration:none;color:#f1f3f3}.release-links{display:flex;flex-direction:row;font-weight:200}.release-links div:not(:first-child){margin-left:1rem}.btn:hover{color:rgba(212,218,218,0.8);text-decoration:none;background-color:rgba(212,218,218,0.2);border-color:rgba(212,218,218,0.3)}.highlight-link{color:#f1f3f3}.highlight-link:hover{color:#d4dada;cursor:pointer;transition-duration:0.5s}.footer-content{font-size:small;color:#999999;display:flex;justify-content:space-between;flex-direction:row}.how-to-header>li:not(:first-child){margin-top:1rem} diff --git a/assets/js/tabs.js b/assets/js/tabs.js new file mode 100644 index 00000000..669752df --- /dev/null +++ b/assets/js/tabs.js @@ -0,0 +1,182 @@ +/** + * Configure the tabs behavior. + */ +const jekyllTabsConfiguration = { + syncTabsWithSameLabels: false, + addCopyToClipboardButton: false, + copyToClipboardButtonHtml: '', +}; + +const jekyllTabsModule = (function() { + + /** + * Remove all "active" classes on li elements that belong to the given ul element. + */ + const removeActiveClasses = function (ulElement) { + const liElements = ulElement.querySelectorAll('ul > li'); + + Array.prototype.forEach.call(liElements, function(liElement) { + liElement.classList.remove('active'); + }); + } + + /** + * Get the element position looking from the perspective of the parent element. + * + * Considering the following html: + * + *++ +We have recently upgraded to
+1.0.0
of the DDK library. See the upgrade guide for more details.
The AWS DataOps Development Kit is an open source development framework for customers that build data workflows and modern data architecture on AWS.
+ +Based on the AWS CDK, it offers high-level abstractions allowing you to build pipelines that manage data flows on AWS, driven by DevOps best practices. The framework is extensible, you can add abstractions for your own data processing infrastructure or replace our best practices with your own standards. It’s easy to share templates, so everyone in your organisation can concentrate on the business logic of dealing with their data, rather than boilerplate logic.
+ +The DDK Core is a library of CDK constructs that you can use to build data workflows and modern data architecture on AWS, following our best practice. The DDK Core is modular and extensible, if our best practice doesn’t work for you, then you can update and share your own version with the rest of your organisation by leveraging a private AWS Code Artifact repository.
+ +You can compose constructs from the DDK Core into a DDK App. Your DDK App can also add contain constructs from the CDK Framework or the AWS Construct Library.
+ +For a detailed walk-through, check out our Workshop or +take a look at examples.
+ +You can install or update the AWS DDK library from the following:
+ + +One of the core features of DDK is ability to create Data Pipelines. A DDK DataPipeline +is a chained series of stages. It automatically “wires” the stages together using +AWS EventBridge Rules .
+ +DDK comes with a library of stages, however users can also create their own based on their use cases, +and are encouraged to share them with the community.
+ +Let’s take a look at an example below:
+ +...
+
+firehose_s3_stage = FirehoseToS3Stage(
+ self,
+ "ddk-firehose-s3",
+ bucket=ddk_bucket,
+ data_output_prefix="raw/",
+)
+sqs_lambda_stage = SqsToLambdaStage(
+ scope=self,
+ id="ddk-sqs-lambda",
+ code=Code.from_asset("./lambda"),
+ handler="index.lambda_handler",
+ layers=[
+ LayerVersion.from_layer_version_arn(
+ self,
+ "ddk-lambda-layer-wrangler",
+ f"arn:aws:lambda:{self.region}:336392948345:layer:AWSSDKPandas-Python39:1",
+ )
+ ]
+)
+
+(
+ DataPipeline(scope=self, id="ddk-pipeline")
+ .add_stage(firehose_s3_stage)
+ .add_stage(sqs_lambda_stage)
+)
+...
+
First, we import the required resources from the aws_ddk_core
library, including the two stage constructs:
+FirehoseToS3Stage(), and
+SqsToLambdaStage().
+These two classes are then instantiated and the delivery stream is configured with the S3 prefix (raw/
).
+Finally, the DDK DataPipeline construct is used to chain these two stages together into a data pipeline.
Complete source code of the data pipeline above can be found in +AWS DDK Examples - Basic Data Pipeline.
+ +