#python

Simplify #devops with Jupyter Notebook
▻https://hackernoon.com/simplify-devops-with-jupyter-notebook-c700fb6b503c?source=rss----3a8144e

https://cdn-images-1.medium.com/max/740/1*pmrv_BOroLiBBMWcU3TMzw.png

Jupyter Notebook is a fantastic tool for data exploration. It combines markdown text, executable code, and output all inside a single document served in a browser. While Jupyter is great for data science, I’m going to demonstrate the use of Notebook for a completely different use case: DevOps Runbooks or simply put way to respond quickly to system outages.ProblemImagine you are spending an evening with your loved one and suddenly see a flurry of slack/pager alerts about your API latency climbing up. It’s all downhill from there. You get online and check all usual suspects: recent deployments, dependent services, load balancer, incoming traffic, database and so on. You jump from terminal to AWS console to NewRelic to conference call and what not. Let’s just say the whole experience is (...)

#jupyter-notebook #cloud-computing #python #infrastructure

I Made a News Scrapper with 100 Lines of #python.
▻https://hackernoon.com/i-made-a-news-scrapper-with-100-lines-of-python-2e1de1f28f22?source=rss-

https://cdn-images-1.medium.com/max/1024/1*IugT4tq7DPXpdSrlxS1TWA.jpeg

Everyday I take subway to my office, where my cellphone has no signal at all. But medium app won’t let me read stories offline, so I decided to make a news scrapper by myself.I didn’t want to make a very fancy application so I only completed the minimal prototype that can satisfy my needs. The concept is very simple:Find some news sourceScrap the news page with PythonParse the html and extract the content with BeautifulSoupConvert it to readable format then send an Email to myselfNow let me explain how I did each part.News Source: RedditPeople submit links to #reddit and vote them, so Reddit is a good news source to read news. Now the problem is: How to get a list of popular news everyday?Before thinking of web scrapping, we should try to find out whether the target website provides any API, (...)

#programming #web-development #with-100-lines-of-python

#python Generators Explained ! (Sort of)
▻https://hackernoon.com/python-generators-35ac68334882?source=rss----3a8144eabfe3---4

https://cdn-images-1.medium.com/max/450/1*9D3HXgwcSZjdXIxviApJMw.jpeg

Learn python generators by example.GENERATORSAs IteratorsUsing generators (generator functions)>>> def integers(): i = 1 while True: yield i i = i + 1>>> a = integers()>>> next(a)1>>> next(a)2>>> next(a)3>>> next(a)4>>> next(a)5>>>Assigning a #generator to a varialble will automatically create ._next_() or next(generator) methodThis will allow you to iterate through the generator valuesConverting to list>>> def yrange(n): i = 0 while i < n: yield i i += 1>>> y = yrange(5)>>> list(y)[0, 1, 2, 3, 4]>>> list(y)[]You can convert a generator to a list however on the process it will lose its value and transfer it to the list.>> y = (...)

#scripting #async-functions #programming

Faire des calculs géographiques en #Python sans PostGIS
▻https://makina-corpus.com/blog/metier/2018/faire-des-calculs-geographique-en-python-sans-postgis

PostGIS est souvent indispensable dans les applications géographiques. Mais ce n’est pas toujours le cas et il est parfois possible de s’en passer. La preuve en image.

#SIG #News_Item

#python Interview Question #fizzbuzz
▻https://hackernoon.com/python-basics-8-fizzbuzz-441e97c6c767?source=rss----3a8144eabfe3---4

https://cdn-images-1.medium.com/max/1024/1*R2fnmU0IU_YB5J2bz4_3hQ.png

▻https://medium.com/media/bd7f5cf49d59a279d36442e185efa6e5/hrefWrite a program that prints the numbers from 1 to 20. But for multiples of three print “Fizz” instead of the number and for the multiples of five print “Buzz”. For numbers which are multiples of both three and five print “FizzBuzz”.Method 1: Concatenating Stringsfor num in range(1,21): string = "" if num % 3 == 0: string = string + "Fizz" if num % 5 == 0: string = string + "Buzz" if num % 5 != 0 and num % 3 != 0: string = string + str(num) print(string)Method 2: Use if, elif, and elsefor num in range(1, 21): if num % 3 == 0 and num % 5 == 0: print(’FizzBuzz’) elif num % 3 == 0: print(’Fizz’) elif num % 5 == 0: (...)

#programming #tutorial #interview-questions

Lessons Learned From Migrating to #python 3
▻https://hackernoon.com/lessons-learned-from-migrating-to-python-3-aeaa1f5eee80?source=rss----3a

https://cdn-images-1.medium.com/max/1024/1*l9f_fZ-ngqStYnn1IQeBXw.jpeg

As the Python 2 End of Life date approaches many developers will need to consider migrating their builds to Python 3. I sat down with Dan Palmer to discuss Thread’s recent migration to Python 3.Thread’s offices in London. This article was originally published on able.bioThread is an online personal styling service. When you sign up, their website asks you a set of introductory questions about your preferred styles, sizes, budget, owned items and so on which their personal stylists use to provide surprisingly well-tailored recommendations. Headquartered in London with around 50 staff, Thread’s #django powered e-commerce website receives approximately 850k visits a month.Rhett: What does Thread’s site architecture look like?Dan: Thread has been strongly powered by Django from day one. The (...)

#migrating-to-python-3 #dan-palmer #python3

How we Built pythonjobs.github.io
▻https://hackernoon.com/building-pythonjobs-github-io-6119cd708802?source=rss----3a8144eabfe3---

https://cdn-images-1.medium.com/max/1024/1*YX04w-q4aEOO_XT2kleYRg.png

Modern open source tools are amazingA while ago, a colleague (@salimfhadley) came over to my desk and mentioned an idea that he’d had:how hard would it be to build a job site that used git pull requests for new job submissions?At the time, the #python.org jobs board had been down for maintenance for nearly a year, and there wasn’t any obvious free, moderated place to list or view job opportunities. Coincidentally, at that time, our employer was hiring, and Sal was heavily involved with that process.Sal’s idea was to to have a static site, using #github pull requests to manage submissions.This idea is awesome for a number of reasons:Lots of tools and services exist to make managing change requests from strangers easyThe entire process is public, transparent, and well understoodHaving a slightly (...)

#recruiting #open-source #python-jobs

Formation #Machine_Learning du 23 au 25 mai à Paris
▻https://makina-corpus.com/blog/formation/2018/formation-machine-learning-du-23-au-25-mai-a-paris

Profitez de cette session parisienne pour vous familiariser avec le Machine Learning !

#Python #News_Item

halhen/viz-pub: A place to publish data-vizes
▻https://github.com/halhen/viz-pub

https://raw.githubusercontent.com/halhen/viz-pub/master/pastime-income/pastime.png

#datavis #R #python #joli

Top 10 #python & Django Web Application Development Companies
▻https://hackernoon.com/top-10-python-django-web-application-development-companies-eda8461c764f?

https://cdn-images-1.medium.com/max/1024/1*u_Jr6FozmyMCi3pe9ZsoFg.png

top 10 Django & python developersList of best 10+ Trusted Python & Django Developers in USA, UAE, UK, & India | Top Developers -2018 ReviewsIn the technical world, both Django, a pragmatic Python framework plays an important role and it has achieved acknowledgment across the world wide, for building high-quality websites, simple applications to complex corporate web applications. Now almost every business people prefer to experience Django development benefits to get a strong customer base.Python and Django Web Application development allows anyone to bring their business ideas into reality by the way it provides the competitive edge for all clients. If you are the business person and interested to give new dimension to your business you must consider choosing the best (...)

#10-python-companies #python-web-developer #python-django-developer #top-10-django-companies

Deploy your Flask API to any #serverless Cloud Platform using this Simple Pattern
▻https://hackernoon.com/deploy-your-flask-api-to-any-serverless-cloud-platform-using-this-simple

I’m going to demonstrate how to make a Flask app serverless without locking you into any tooling or cloud platforms. It doesn’t require any application code changes or serverless frameworks so you can continue to develop locally like you always have.Ideally you should re-architect your application into small discrete functions to take full advantage of serverless. However, if you want to migrate a legacy application or just a quick way to get started with serverless then this is a good approach to take.Create Flask ApplicationWe are going to create a Flask application for Python3.6+.SetupFirst create a virtual environment and install dependencies.$ python3 -m venv env $ source env/bin/activate$ pip install flask flask-lambda-python36 http-promptApplication CodeAdd the code below which (...)

#development #programming #python #aws-lambda

#gambling & Probability (Python)
▻https://hackernoon.com/gambling-probability-python-dfd3e301b1ad?source=rss----3a8144eabfe3---4

https://cdn-images-1.medium.com/max/700/0*yyIDj96HTULiL4Qk.png

I recently became interested it the probability of certain outcomes. #python gives us a great way to test scenarios to see how likely certain scenarios are, by allowing you to run certain scenarios millions and millions of times, and calculate the number or times in a certain outcome happens.. Take, for example, a coin toss. We might be interested in seeing the probability of either a heads or tails outcome on any given coin toss. We could run a million coin tosses, and find out how likely each scenario is.With coin tosses, etc, the outcomes depend largely on a random choice between two or more possibilities. Python includes a library called ‘random’, which you can use by importing the library with import random. Using random, I set up a script to determine a heads or tails probability, (...)

#mathematics #profitability #java

Analysing 1.4 billion rows with #python
▻https://hackernoon.com/analysing-1-4-billion-rows-with-python-6cec86ca9d73?source=rss----3a8144

https://cdn-images-1.medium.com/max/935/1*JBBDttphxwvek-nhV9v6eg.png

Using pytubes, numpy and matplotlibThe Google Ngram viewer is a fun/useful tool that uses Google’s vast trove of data scanned from books to plot word usage over time. Take, for example, the word Python (case sensitive):Untitled graph taken from: ▻https://books.google.com/ngrams/graph?content=Python&year_start=1800&corpus=15&smoothing=0 charting the usage of the word ‘Python’ over time.It’s powered from google’s n-gram dataset, a log of the number of times a particular word or sequence of words was spotted by google books during each publication year. While not complete (it doesn’t include every book ever published!), there are millions of books in the set, including books published in the 1500s and up to 2008. The dataset can be freely downloaded here.I decided to see how easy it (...)

#data-science #big-data #programming

Setup #python Environment for ml and Deep Learning
▻https://hackernoon.com/setup-python-environment-for-ml-and-deep-learning-c57ea54818ec?source=rs

https://cdn-images-1.medium.com/max/539/0*yUmYHb1U2hmII9Fd.png

Originally Published 12 May 2017This page gives quick and easy steps to setup your machine for machine learning and deep learning.Hi guys, In python there are many prebuilt libraries which can be used for machine learning and deep learning. But one major problem lies in setting up the environment for development using these libraries (especially for Windows based machines).Since most of these libraries were built to be used on Linux (Ubuntu etc), its easier to setup the working environment in Linux. At the same time its a very confusing and lengthy procedure on Windows machine.So below are the steps to get you up and running for ml and deep learning development on Windows:Step 1: Download Anaconda DistributionFor your version of system 32bit or 64bit from here Its better to select the (...)

#python-environment-for-ml #machine-learning #deep-learning #mls

Deploy a #serverless flask application on #aws Lambda
▻https://hackernoon.com/deploy-a-serverless-flask-application-on-aws-lambda-d8ca58af42a4?source=

https://cdn-images-1.medium.com/max/1024/1*vhdmyJrtqT6n0G2djDo0EQ.jpeg

ServerlessServerless is one of the new buzz word right now, what does it really means? Serverless computing allows us to focus on building the application without managing infrastructure and scaling. Serverless doesn’t mean no servers at all. It is still there, but we are not going to manage it. The best part is that you only pay for the amount of resources each request consumed. Each request to the serverless function is allocated and the application code runs in a stateless container.Advantages: Horizontally scalable Pay for what you use* Infrastructure managed by service providerAWS LambdaAWS provides serverless service called "Lambda" which can be used to deploy and run serverless applications. AWS lambda lets us run any #python WSGI based applications on cloud. It To (...)

#flask-application #aws-lambda

#Machine_Learning : classer automatiquement vos données à l’import
▻https://makina-corpus.com/blog/metier/2018/machine-learning-import-donnees

Comment utiliser des algorithmes de machine learning pour importer correctement des données dans vos projets de DataScience ?

#Python #News_Item

Superset, l’outil de #Dataviz de AirBnB
▻https://makina-corpus.com/blog/metier/2018/superset-loutil-de-dataviz-de-airbnb

Superset est un outil développé par AirBnB. Son objectif consiste à faciliter la prise de décision au sein d’une entreprise, en simplifiant l’accès à ses données. Superset permet notamment de regrouper les informations fournies par différentes sources, de créer des graphiques interactifs et de les partager sous forme de tableaux de bord.

#Python #News_Item

Information Security : How to DoS 29% of the World Wide Websites - CVE-2018-6389
▻https://baraktawily.blogspot.fr/2018/02/how-to-dos-29-of-world-wide-websites.html

et hop ! encore une vulnérabilité de Wordpress rendue publique sans qu’il y ait de correctif officiel ! (avec y compris le script python « qui va bien » pour réaliser le DDOS...)

Voir aussi : le patch officieux (script bash modifiant les fichiers en cause) : ▻https://github.com/Quitten/WordPress/blob/master/wp-dos-patch.sh

#vulnérabilité #wordpress #DDOS #python

Scraping & Machine Learning : comment fonctionne un moteur de recherche ?
▻https://makina-corpus.com/blog/metier/2018/seo-scraping-machine-learning-comprendre-le-fonctionnement-dun-moteur

Ou comment utiliser des composants libres pour faire votre mini-Google (ou Qwant)

#Python #SEO #News_Item

#Python pour la Création littéraire
▻http://constantvzw.org/site/Python-for-Literary-Creation,2908.html

OLA est l’abbréviation pour l’organisation parisienne, Outils Libres Alternatifs. Ils invitent An Mertens pour un #Atelier d’écriture littéraire avec Python. Une ligne de code est comme l’action d’une recette. On prépare un ingrédient, on applique l’action et l’ingrédient sera transformé. Oulipo, le collectif autour de Raymond Queneau, a exploré l’idée des recettes ou contraintes pour créer de potentielles littératures. Leur travail est une grande inspiration pour écrire en utilisant du code. A l’aide (...)

#Algolit / Atelier, Python, #Littérature

#Python for Literary Creation
▻http://constantvzw.org/site/Python-for-Literary-Creation.html

OLA is the TLA for the Parisian organisation Outils Libres Alternatifs (Alternative Free Tools). They will host a #Workshop with An Mertens on using Python code for literary creation. A line of code is like an action of a recipe. One prepares an ingredient, applies the aciton and the ingredient will be transformed. Oulipo, the Parisian collective around Raymond Queneau explored the idea of recipes or constraints for creating potential literatures since the 60s. Their work is a great (...)

#Algolit / Workshop, Python, #Literature

Découvrez la formation #Python #Initiation au Scientifique
▻https://makina-corpus.com/blog/formation/2017/formation-python-initiation-scientifique

La formation Python initiation au scientifique vous permettra de vous initiez à la programmation scientifique grâce au langage Python et à ses nombreuses bibliothèques.

#Dataviz #Découverte #Débutant #News_Item

Convertir une base de données SQLite vers MySQL/MariaDB - PAB’s blog
▻https://blog.bandinelli.net/index.php?post/2014/03/27/sqlite3-to-mysql

LE script miraculeux pour la conversion sqlite > sql
NB : ne pas oublier de faire un rechercher/remplacer pour virer les chaînes COLLATE NOCASE et COLLATE BINARY avant de lancer l’import du fichier SQL obtenu.
...et ne pas oublier de remettre le AUTO_INCREMENT sur tous les champs id_<objet> qui sont les clés primaire des tables spip_<objet>

#conversion #sqlite #mysql #mariadb #python #utilitaire #SPIP

#Formation Machine Learning
▻https://makina-corpus.com/blog/formation/2017/formation-machine-learning

Cette formation présente le domaine du Machine Learning, au travers de l’écosystème #Scientifique du langage #Python.

#Science #News_Item

Localisation d’un objet par classification de superpixels
▻https://makina-corpus.com/blog/metier/localisation-dun-objet-par-classification-de-superpixels

Dans ce tutoriel, vous apprendrez comment réaliser un programme #Python capable à d’apprendre à localiser un objet au sein d’une image.

#machine_learning #Tutorial #Scientifique #News_Item