#aws

#aws Landing Zone Solution -Accelerating #cloud Adoption
▻https://hackernoon.com/aws-landing-zone-solution-accelerating-cloud-adoption-2b1c17017bc?source

https://cdn-images-1.medium.com/max/1024/1*_z40fnfE1592XeR5PrXb5w.png

Amazon Web Services (AWS) is an extensive cloud service platform by Amazon that extends database storage, computing power, content delivery, etc. helping businesses grow. AWS assist companies with a myriad of tasks including data processing, warehousing, game development and a lot more. Owing to its unique offering, the popularity of AWS continues to grow as it generated net sales revenue of a whopping USD 232 Billion in the year 2018.Challenges of Creating AWS AccountCreating an AWS account is a strenuous task to accomplish as it involves multiple steps that require manual authorization. Additionally, there are various other factors to take into consideration like the requirement of IAM (Identity and Access Management) account, logging accounts, handling of cross-account permissions (...)

#landingzone #devops #cloud-services

Real World Architecture in the Cloud Using Event-Driven Techniques to Build a PDF Rendering…
▻https://hackernoon.com/real-world-architecture-in-the-cloud-using-event-driven-techniques-to-bu

https://cdn-images-1.medium.com/max/1024/1*FsMpJzZg39ZC-_KaOKwMOA.png

Real World Architecture in the Cloud Using Event-Driven Techniques to Build a PDF Rendering Pipeline▻https://medium.com/media/71d4979b514b8833e4f1f4cf77d1b358/hrefJon Christensen and Chris Hickman of Kelsus discuss an example of a real-world architecture in the Cloud using event-driven techniques to add a new feature, such as building a PDF-rendering pipeline for an existing application.Some of the highlights of the show include:Form/Document/PDF: Common request when building applications for enterprises to automate a business process previously done manuallyOnline forms-based application can perform regular quality checks at various locations to to generate evidence that work is being scheduled and performed properlyForms are submitted into system; application lets others view, share, (...)

#cloud-services #event-driven-architecture #aws #event-driven-systems #pdf-rendering-pipeline

Getting down and dirty with metric-based alerting for #aws #lambda
▻https://hackernoon.com/getting-down-and-dirty-with-metric-based-alerting-for-aws-lambda-44dee79

https://cdn-images-1.medium.com/max/1024/1*xi_VBKfCHlS816Lr3rfIWA.jpeg

The phrase “better safe than sorry” gets thrown around whenever people talk about monitoring or getting observability into your AWS resources but the truth is that you can’t sit around and wait until a problem arises, you need to proactively look for opportunities to improve your application in order to stay one step ahead of the competition. Setting up alerts that go off whenever a particular event happens is a great way to keep tabs on what’s going on behind the scenes of your #serverless applications and this is exactly what I’d like to tackle in this article.AWS Lambda MetricsAWS Lambda is monitoring functions for you automatically, while it reports metrics through the Amazon CloudWatch. The metrics we speak of consist of total invocations, throttles, duration, error, DLQ errors, etc. You (...)

#aws-lambda #metrics-and-analytics

How to Build a Member App using Facial Recognition and #serverless
▻https://hackernoon.com/how-to-build-a-member-app-using-facial-recognition-and-serverless-ed33c3

https://cdn-images-1.medium.com/max/272/1*Ht73wKugmi8Iq2lW5WE2LA.jpeg

Using #aws #rekognition and serverless, we can build a scalable member management system to replace membership cards.This sample app is designed for clubs, gyms, museums (or even Costco )— any organization that has membership cards with a photo to gain access. With just a few serverless tools, we can develop a scalable, durable membership management system that uses facial recognition to keep track of members.The app allows an administrator to enroll faces in their organization, and then verify new faces against the known membership list. In traditional app development, this would be a major undertaking but in serverless it’s easier than you might think.The key takeaways in this project are that serverless lets us clearly delineate the front-end and back-end of a web-app, and by hooking (...)

#vuejs #aws-rekognition

Open Source Tension — Who Should Profit?
▻https://hackernoon.com/open-source-tension-who-should-profit-55e529000b84?source=rss----3a8144e

Open Source Tension — Who Should Profit?▻https://medium.com/media/8f00c1abfa89b45cc3ea6e5594ba6066/hrefTwitter has been all a flutter with tweets on open source, specifically about what you do when open source meets the Cloud. Jon Christensen and Chris Hickman of Kelsus and Rich Staats of Secret Stache discuss the tension between creators and commercial users of open source software and projects.Some of the highlights of the show include:Open source companies and sponsors being taken for granted and feeling pressured to find ways to make moneyTension stems from economic and open source business model changes over the last few years; open source projects need to figure out how to adapt to themRedislabs revised its open source license to be modified with the Commons Clause for protection from (...)

#aws #open-source #open-source-profits #open-source-podcast #open-source-tension

Understanding the scaling behaviour of #dynamodb OnDemand tables
▻https://hackernoon.com/understanding-the-scaling-behaviour-of-dynamodb-ondemand-tables-80d80734

https://cdn-images-1.medium.com/max/1024/0*_aOv3BPcNNx8hI2m.png

Back when #aws announced DynamoDB AutoScaling in 2017, I took it for a spin and found a number of problems with how it works.At re:invent 2018, AWS also announced DynamoDB OnDemand. DynamoDB OnDemand tables have different scaling behaviour, which promises to be far superior to DynamoDB AutoScaling.Talking with a few of my friends at AWS, the consensus is that “AWS customers no longer need to worry about scaling DynamoDB”! So I ran a number of experiments to help me understand how OnDemand tables deal with sudden spikes in traffic.From 0 to 4000, no problem!Let’s assume that a newly created table can handle X amount of read/write throughput before it needs to scale. We can find out the value of X by:create a new tablegenerate a traffic that ramps up to Y writes/s throughput in one minute (using (...)

#cloud-computing #scalability #cloud

Independently Scalable Multi-Container #microservices Architecture on #aws #fargate (II)
▻https://hackernoon.com/microservices-on-fargate-part2-f29c6d4d708f?source=rss----3a8144eabfe3--

https://cdn-images-1.medium.com/max/1024/1*HJpI3hGv73wzp5atvI0HHA.jpeg

In this article we will be building the stack of resources needed to run the application we prepared and containerized in the first part:Independently Scalable Multi-Container Microservices Architecture on AWS Fargate (I)The application source and CloudFormation stack file can be found here:docwhite/ecsfsOverviewThe ideas and requirements for this application, ecsfs, are:Backend and frontend services not to be public-facing.Nginx will sit on the front, publicly accessible.Nginx would proxy the request to the frontend.The frontend requests from the backend.Auto-scalable backend (since it performs expensive computations).In order to address (1) and (2) we will require private and public subnets. To forward all traffic to the nginx server (2) we will set up an Application Load Balancer (...)

#cloud #docker

Authorized requests to #s3 bucket
▻https://hackernoon.com/authorized-requests-to-s3-bucket-6c64ba02f60c?source=rss----3a8144eabfe3

https://cdn-images-1.medium.com/max/422/1*BsS33Afv1Qzm7DU-XLJX0g.png

Protected S3 buckets, protected filesThis notebook shows the finished product of adding basic permissioning to an S3 bucketWe use basic auth which is an HTTP protocol for simple auth on web-accessible files. ▻https://en.wikipedia.org/wiki/Basic_access_authenticationBasic auth isn’t very secure — however, we pair this with HTTPS and restrict access to the s3 bucket.Set up some python stuffIn [1]:import requests; import jsonAccess secure endpoint without authfirst were gonna try to access this file without any credentialsIn [2]:url = ’▻https://d17nii79zr8aom.cloudfront.net/success.json'resp = requests.get(url)resp.contentOut[2]:’Unauthorized’Next we add basic auth paramsAccess secure endpoint with auth!In [3]:user, password = ’user’, ’pass’resp = requests.get(url, (...)

#cybersecurity #aws #authentication #jupyter-notebook

Using #gitlab CI/CD to auto-deploy your Vue.js application to #aws S3
▻https://hackernoon.com/using-gitlab-ci-cd-to-auto-deploy-your-vue-js-application-to-aws-s3-9aff

https://cdn-images-1.medium.com/max/1024/1*iKzGFY_QP1l3fsP2jY9Zgg.png

GitLab CI/CD — Vue.js — Amazon S3In my previous years as an engineer, I always looked at Continuous Integration/Continuous Delivery (CI/CD) with a smug face. It has never been anything but a rough experience (thank you, Jenkins 🤢). However, it is my firm belief that in 2019 we will be seeing an uptick in conversation about how to easily manage and deploy your apps; considering developing the app is only a single step, right?For this article, I am going to assume that you have already created a Vue.js application and are now ready to set up with GitLab’s continuous deployment.Although this article shows how to deploy a Vue.js app, it is the basic structure for using GitLab’s CI/CD to deploy anything to S3.First things first, let’s set up an AWS account and create a new S3 bucket! Any new AWS (...)

#vuejs #git #javascript

What is #aws #lambda or #serverless ?
▻https://hackernoon.com/what-is-aws-lambda-or-serverless-f0a006e9d56c?source=rss----3a8144eabfe3

https://cdn-images-1.medium.com/max/800/1*-P0w5Fgk5Ixj_3IEmjAL7g@2x.png

AWS Lambda logoThere has been a lot of talk about serverless and AWS lambda these days. More and more companies and teams are switching towards the serverless architecture for their applications.In this article, I will be explaining serverless and we will be deploying our first hello world lambda function!What is Serverless?Serverless simply means that you don’t have to manage the servers on which your application runs.You don’t have to take care of patching the system, installing antivirus software or configuring firewalls. Also, you don’t have to worry about scaling your application as the load increases, it is handled automatically!Hence, it allows you to focus more on the functionality of your application.Why is it better?Normally, when you are creating a dynamic web application you (...)

#cloud #cloud-computing

Deploying on #aws Free Tire with #docker and Fabric
▻https://hackernoon.com/deploying-on-aws-free-tire-with-docker-and-fabric-d9eca7c629e6?source=rs

https://cdn-images-1.medium.com/max/1024/1*SGA_SR5f8n2bDDTc4GGASA.png

In this article i want to summarize all things that u will need to make good dev environment and deployment for a small application. To make this happen we will use AWS Free Tire and Docker containers and orchestration and #django app as a typical projectLink on this project github: ▻https://github.com/creotiv/aws-docker-exampleBefore go farther please install Docker first: ▻https://docs.docker.com/install/linux/docker-ce/ubuntu/All code running under Python 3.6DockerDocker is a container virtualization engine that gives u ability to create cheap and fast environments for production and development use. Containers are not virtual machines. Key idea of containers is to make them as thin as possible. So you cant run Windows container on Linus system. Here is good image to see the (...)

#devops #aws-free-tire

Building RESTful APIs (Authentication & Error Handling)
▻https://hackernoon.com/building-restful-apis-authentication-error-handling-4013681381a2?source=

▻https://medium.com/media/7a227f639a07519d5e744c1de06d2f11/hrefSubscribe to MobycastiTunes | Google Play | Soundcloud | Stitcher | SpotifyShow NotesJon Christensen and Chris Hickman of Kelsus and Rich Staats of Secret Stache continue their conversation on building RESTful APIs, specifically focusing on #authentication and error handling. REST stands for Representational State of Transfer.Some of the highlights of the show include:Importance of authentication with APIs to identify callers and their authorized permissionsStateless vs. stateful communication channels between entitiesSimplest authentication technique is to use basic HTTP metadata in headers; you must send it over an encrypted connectionExchanging short-lived tokens negotiated based upon user’s credentials is another  (...)

#restful-api #error-handling #api #aws

Independently Scalable Multi-Container #microservices Architecture on #aws #fargate (I)
▻https://hackernoon.com/microservices-on-fargate-part1-f26a318827a8?source=rss----3a8144eabfe3--

https://cdn-images-1.medium.com/max/1024/1*5ZYfVCDsg07UXAT66EUc7Q.jpeg

Various cafés and boutiques stacked up at The Cafe Apartments in Vietnam.A guide on deploying a full stack (nginx, frontend, backend) application on AWS using #docker, Fargate and CloudFormation.Few weeks ago I started my journey through AWS. Now I got to a point where I feel confident to share my journey and some ideas that might help others.The reason I am writing this article is because I saw many examples of backend-frontend-nginx stacks in Fargate but not in a way that you could scale each component independently.On all those examples if you wanted more backend availability you would need to scale frontend and nginx with it because all containers were defined together and would run as one big service. It was not what I was after.This guide is structured as follows:Part 1: why (...)

#aws-fargate

How to Unwrap an AggregateException Thrown by #aws #lambda
▻https://hackernoon.com/how-to-unwrap-an-aggregateexception-thrown-by-aws-lambda-6652fd085952?so

https://cdn-images-1.medium.com/max/1024/1*zEBtn3FyT0jD78047BvStQ.png

If you’ve written a .NET Lambda function which calls async code and returns either Task or Task<T>, you’ve probably seen an AggregateException which wraps the real exception.This example comes from the handler below which calls an asnyc method that always throws a FormatException.The AggregateException can be unwrapped, though. When AWS added .NET Core 2.1 support to Lambda, they also added an undocumented feature toggle. The only real mention of it is by the AWS .NET team on Reddit.When the UNWRAP_AGGREGATE_EXCEPTIONS environment variable is set to 1 or true, Lambda will call GetAwaiter().GetResult() instead of using theResult property.Note that this only works if your method returns Task or Task<T>.This causes the first exception thrown to be returned instead of an (...)

#dotnet-core #serverless #csharp

Pub/Sub with #aws SNS, SQS and #laravel
▻https://hackernoon.com/pub-sub-with-aws-sns-sqs-and-laravel-ed9f7e1bd79?source=rss----3a8144eab

https://cdn-images-1.medium.com/max/1024/1*3ZseBY2JmWFXAvlHlQoehA.png

Pub/Sub is a great mechanism to establish microservice communication. By focusing on defining good, reliable topics of interest, microservices can come and go without disrupting the entire ecosystem. AWS offer two great services that help build a highly scalable, reliable and recoverable pub/sub system: Simple Notification Service and Simple Queue Service.Introduction to microservice communicationWhen service A communicate with B via direct call, we can infer that there is a dependency in A coupled to B. If B is temporarily unavailable or under heavy load, it could disrupt the stability of A.Writing coupled microservices usually means dealing with the worst of both worlds. If instead the system was built like a monolith, it would still be coupled to each other, but without the problems (...)

#software-development #sqs-and-laravel #php

The $300 Lettuce : Building a Smart Garden
▻https://hackernoon.com/the-300-lettuce-building-a-smart-garden-c048c0e1a51?source=rss----3a8144

https://cdn-images-1.medium.com/max/776/1*YihMlrGPajr22Wx6qmO_hw.png

A few months ago, a very generous friend of mine gave me a fantastic gift, my very own Raspberry Pi 3B+. For those who are unfamiliar, a Raspberry Pi is a small and affordable computer which can also be connected to sensors and other electronics.The first challenge was deciding what to do. I’m always looking to extend my skills as a software developer, and I’d been toying with the idea of growing some vegetables. Receiving the Raspberry Pi was exactly the impetus I needed to start a project: a smart hydroponic garden system, with automated alerts, data analysis and maintenance.Spoiler Alert: If you’re only looking to grow food, this project isn’t particularly efficient. Applying computing to a small home garden is time consuming, sometimes costly, and doesn’t necessarily improve yield. (...)

#raspberry-pi #aws #cloud-computing #hydroponics #iot

What is Amazon Lightsail?
▻https://hackernoon.com/what-is-amazon-lightsail-beaef47dd64e?source=rss----3a8144eabfe3---4

https://cdn-images-1.medium.com/max/1024/1*QiHBlwnNjmRVnF7EiVsviQ.jpeg

Amazon Lightsail LogoIf you are new to #aws and looking to deploy some servers for your applications then AWS Lightsail may be the best starting point for you.Unlike Amazon EC2, you are given a nice interface where you can select preconfigured plans that may cover most of your use cases.Just with 3–4 clicks you can launch a WordPress website running on Linux server.You also don’t have to worry about determining the cost since the cost is fixed monthly.Along with servers, you can also create databases, load balancers, and storage on Lightsail.Now let’s get practical and quickly launch a Node server with Lightsail!Launching an InstanceFirst, log into your AWS console and in the All Services tab under Compute you will find Lightsail. Click on it, it will open the Lightsail dashboard in a new  (...)

#amazon-lightsail #cloud-computing #computer-science #software-development

Your Kid Can Code a Fruit Detector with This MIT App Inventor #aws #ai Services Extension
▻https://hackernoon.com/your-kid-can-code-a-fruit-detector-with-this-mit-app-inventor-aws-ai-ser

https://cdn-images-1.medium.com/max/532/1*7P8PdfukIjj07hJ_5VyvGw.png

I am using Amazon Web Services (AWS) for more than 2 years. I have always been thinking about finding ways for enabling anyone to use AWS cloud services. Especially I am trying to encourage kids to learn simple AI services that AWS provides.This easy to use AI services includes a chat-bot generation service called Amazon Lex, a text-to-speech service called Amazon Polly, an image and video recognition service called Amazon Rekognition and a language translation service called Amazon Translate.Visual block based programming tools are an important tool for teaching coding to kids. One of the most popular block based programming environment is Scratch. Scratch is a joint project between Google and MIT Media Lab and based on a Google project called Blockly, declared in 2012.In my previous (...)

#amazon-translate #amazon-rekognition #amazon-polly

Deploying a Node.js #twitter Bot on AWS Lambda using #webpack
▻https://hackernoon.com/deploying-a-node-js-twitter-bot-on-aws-lambda-using-webpack-df6e2e187a78

https://cdn-images-1.medium.com/max/1024/1*DieJz9sNLgCBgPlraWy85Q.png

I recently had an idea for a Twitter bot for the #LearnInPublic community, which I thought would be a fun project with half a day worth of work. Moreover, I wanted to use AWS Lambda function for the sake of learning. Why AWS Lambda? Because it’s practically free for maintaining a twitter bot and I got hands on experience with a seemingly complex tool used widely in the industry. You get 1,000,000 free requests and 400,000 seconds of compute time per month for AWS Lambda. My bot uses 0.02% of the above numbers.In the process I found a cool use-case Webpack. I had fun reading the webpack docs and figuring learning about the gotchas. Even though it was a very primitive use-case, felt like a true Sean Larkinn for a day. Here is a detailed article on how you could do the same.A little about (...)

#aws-lambda #nodejs #javascript

Is Being VC Backed #startup Really Compatible with Open Source Business Models?
▻https://hackernoon.com/is-being-vc-backed-startup-really-compatible-with-open-source-business-m

https://cdn-images-1.medium.com/max/900/1*8h3dOdpXHaJzBTNLZUrUQA.jpeg

After closing their latest funding round, Redis Labs (circa $146 millions raised to date) announced new licence changes (again) to their Redis Modules. Before that we had high profile startups Confluent (behind Apache Kafka with circa $205m raised to date) and MongoDB Inc (now a public company) change their licences. These licence changes are according to their executives necessary to protect against what they perceive as unfair practices from big cloud vendors (Amazon Web Services often cited as biggest culprit) — who do not make significant contributions (or none at all!) to open source projects and yet fork projects to create competing hosted services. The following are some of the quotes from Redis Labs and Confluent executives that echo the sentiment of unfairness towards the big (...)

#open-source #silicon-valley #aws #venture-capital

Chaos test your Lambda functions with Thundra
▻https://hackernoon.com/chaos-test-your-lambda-functions-with-thundra-48743fe98a91?source=rss---

Failures are inevitable. Just as we need to test our application to find bugs in our business logic before they affect our users. We need to test our application against infrastructure failures. And we need to do it before they happen in production. and cause irreparable damages.The discipline of Chaos Engineering shows us how to use controlled experiments to uncover these weaknesses.In this post, we will see how we can leverage Thundra’s span listeners to inject failures into our #serverless application. We will use these failures to expose weaknesses such as:Missing error handler for DynamoDB operations.Missing fallback when the primary data source is unavailable.Missing timeout on outbound HTTP requests.But first, here’s a quick primer on Thundra.Hello, Thundra!Consider an API with two (...)

#lambda-function #aws #cloud-computing #aws-lambda

Building JAMstack Applications with Gatsby and #aws #amplify Framework
▻https://hackernoon.com/building-jamstack-applications-with-gatsby-and-aws-amplify-framework-d7e

https://cdn-images-1.medium.com/max/1024/1*LjvPx1yUPiA90xr_eSjV3Q.png

When it comes to performance these days, it’s not uncommon to hear the term “JAMstack”. JAMstack stands for JavaScript, APIs, and Markup. The idea being to create static markup with JavaScript that is powered by communicating with APIs.The reason this stack has become so popular is because it allows websites or apps to be bundled up and served at “the edge” via a CDN. Couple this with what is ideally a performant app that is talking to performant APIs and you get a speedy user experience.GatsbyJS is a great solution for creating markup with JavaScript, but what about the APIs part and serving your site to the world? Well really, that’s up to you, but in this post I’ll walk through how you can:Use AWS Amplify and AWS Cognito to set up authenticationUse AWS #appsync to create powerful APIs that (...)

#graphql #react

Le nez de Cléôpatre et les Dick Pics de Jeff Bezos.
▻https://www.affordance.info/mon_weblog/2019/02/amazob.html

L’histoire est à elle seule emblématique de tout ce qu’est devenu internet et l’accès à l’information depuis les 20 dernières années. Elle est aussi la plus formidable métaphore des questions liées aux différents régimes de surveillance qu’inaugure le numérique. Laissez-moi vous expliquer pourquoi. Et commençons par un rapide rappel des faits (pour une version longue, jetez un oeil chez Olivier Tesquet de Télérama) Episode 1 : Dans la foulée du divorce le plus cher de toute l’histoire des divorces chers (...)

#Amazon #AWS #manipulation #domination #neutralité #surveillance #hacking

##neutralité
▻https://www.affordance.info/.a/6a00d8341c622e53ef022ad3c0cbde200d-600wi

Better local development for #serverless Functions
▻https://hackernoon.com/better-local-development-for-serverless-functions-b96b5a4cfa8f?source=rs

https://cdn-images-1.medium.com/max/1024/1*roedigbmFjRYkZobdZWuKg.jpeg

Lambda is a terrific piece of kit for all the benefits listed on the #aws product page and Serverless is a very useful framework for developing Lambda functions. However, developing serverless applications locally is a total pain if what you’re solving isn’t totally trivial.When things get complicated and your Lambda functions start to integrate with other AWS services, things really begin to break down. There are a few things that look like silver-bullets, I’ll share them here and explain why they didn’t work for me, then give you a working example that I myself struggled to find(hence me writing this).LocalstackLocalstack is definitely the biggest attempt silver bullet here. Basically emulate a huge chunk of AWS locally and connect your serverless functions into that. Why I didn’t use  (...)

#serverless-functions #javascript #jest

#npm Package Verification — Ep. 2
▻https://hackernoon.com/npm-package-verification-ep-2-2b2ec66eb610?source=rss----3a8144eabfe3---

https://cdn-images-1.medium.com/max/300/1*TOWfVGpHDD6Dg4jVUrzf4w.png

NPM Package Verification — Ep. 2Minimum Viable Package Verification as a Service (MVPVaaS)TL;DRI built a super-extra-pre-alpha version of PVaaS (Package Verification as a Service) that is running in the cloud. There is a JSON route that surfaces verification data for a package, and a badge route that, well, gives you a badge.Does a package verify? ▻https://api.verifynpm.com/v0/packages/tbvA previous version? ▻https://api.verifynpm.com/v0/packages/tbv@0.3.0How ‘bout a badge: ▻https://api.verifynpm.com/v0/packages/tbv/badgeI cannot emphasize enough how experimental all of this is! I will not make any breaking changes to the version zero API, however, I can’t make any promises that the API is, ya know, permanent. Feel free to tinker with it. All of the source code is available on GitHub: (...)

#javascript #security #aws-lambda #npm-package-verification