“Researchers find bug in #Python script may have affected hundreds of [scientific] studies [in biology]”
▻https://arstechnica.com/information-technology/2019/10/chemists-discover-cross-platform-python-scripts-not-so-cross-platform
“#Willoughby_Hoye” scripts used OS call that caused incorrect measurements on some platforms.
The paper showing the problem: ▻https://pubs.acs.org/doi/full/10.1021/acs.orglett.9b03216
The original paper with the bug: ▻https://www.nature.com/articles/nprot.2014.042
Créer une application web avec Jupyter, ipywidgets et voilà
▻https://linuxfr.org/news/creer-une-application-web-avec-jupyter-ipywidgets-et-voila-7b03d5dd-ab10-47
Python’s creator thinks it has a diversity problem — Quartz
▻https://qz.com/1624252/pythons-creator-thinks-it-has-a-diversity-problem
In a rare interview with the programmer in October last year, which was recently published on YouTube, he was asked about the lack of diversity among the people working on open-source programming languages. He noted that it was an issue, and said that those who ignore it, because open-source projects are available for anyone to contribute, are not seeing the full picture.
“It’s not just joining a project that’s the problem, it’s staying in the project, which means you have to feel comfortable exchanging emails and code reviews… with people that you don’t know personally but you communicate frequently with online,” he said. Van Rossum thinks that these exchanges can be difficult for women because of unconscious bias and male-driven cultural norms within open-source communities.
“It’s not just about writing the code, but you have stand up for your code and defend your code, and there is a certain male attitude that is endemic in many projects where a woman would just not feel comfortable claiming that she is right,” he explained. “A guy who knows less than that woman might honestly believe [he is right], so they present a much more confident image.” In his experience, van Rossum sees incompetent men’s ideas gaining acceptance more often than merited because they are more forceful in how they present them.
Van Rossum believes that the different attitudes of women and men in programming communities is due to wider societal problems that we need to fix from the bottom up. “I’ve always felt that feminism was right and we need to change the whole society,” he said. In the meantime, he feels a responsibility to act in the places he has influence, like in the Python community.
He believes the key to making open-source communities more inclusive is establishing (and enforcing) codes of conduct and mentoring. Van Rossum says that he now mentors women and underrepresented minority programmers. “But white guys can forget it,” he said. “They are not the ones who need it most.” (In typical programmer speak, he calls mentoring a “completely distributed, democratic approach.”)
Rather, he thinks it’s important that men are educated about their biases. “[There are] some guys who are super defensive when you tell about this shit, but the majority of guys just don’t know any better,” he said. “The first time I heard the term unconscious bias was maybe five years ago and it was an eye opener.” It’s changed him, and he thinks it could change others.
Utilisation de la vision par ordinateur pour redresser des images
▻https://makina-corpus.com/blog/metier/2019/redressement-dimages
Dans un module de comparaison d’images, lorsque deux photographies ne sont pas cadrées de la même manière, non-superposable, c’est frustrant. On vous propose ici d’y remédier avec du redressement d’images par homographie.
How to Hire a Python Developer With Right Skill Set?
▻https://hackernoon.com/how-to-hire-a-python-developer-with-right-skill-set-764a12cc5b4f?source=
Bram Cohen has beautifully crafted Python language in a nutshell, as “simple, clean syntax, object encapsulation, good library support and optional named parameters”.Hence hiring a Python developer is the best approach for any company where it has a huge potential to grow any business to a great extent. Some of the pioneers in the technology industry like YouTube, Reddit, NASA, PayPal, Spotify, Quora etc are the popular projects that are built using Python language. Hire a python developer to get benefited from the compelling features of the Python program.Why Python is a preferable language among the companies?In the era of Artificial Intelligence and Machine Learning certain programming languages always have a standard demand in the market irrespective of the evolution of other niche (...)
#hire-python-developers #python-programming #python-web-development #hire-python-programmers #python-web-developer
#python is First Step to Data Science
▻https://hackernoon.com/python-is-first-step-to-data-science-705911ddf5a1?source=rss----3a8144ea
The steadily increasing importance of data science across industries has led to a rapid demand for data scientists. It’s been said that the role of data scientist is the 21st century’s sexiest job title. If you wonder why it has become such a sought after position these days, the short answer is that there has been a huge explosion in both data generated and captured by organizations and common people and data scientists are the people who derive valuable insights from that data and figure out what can be done with it.If you go through some job advertisements for data scientists, you’ll see that expertise in data science and Python are considered as two of the most crucial skills described.In this post, we’re going to discuss why these skills are considered must for data scientists.1- What (...)
Pyodide: Bringing the scientific #Python stack to the browser - Mozilla Hacks - the Web developer blog
▻https://hacks.mozilla.org/2019/04/pyodide-bringing-the-scientific-python-stack-to-the-browser
Pyodide is an experimental project from Mozilla to create a full Python data science stack that runs entirely in the browser.
Our 25 Favorite Data Science Courses From Harvard To Udemy
▻https://hackernoon.com/our-25-favorite-data-science-courses-from-harvard-to-udemy-9a89cac0358d?
Originally Posted HereLearning every facet of data science takes time. We have written pieces on different resources before. But we really wanted to focus on courses, or video like courses on youtube.There are so many options, it can be nice to have a list of classes worth taking.We are going to start with the free data science options so you can decide whether or not you want to start investing more in courses.Tip : Coursera can make it seem like the only option is to purchase the course. But they do have an audit button on the very bottom. Now, if you appreciate Coursera, by all means, you should purchase their specialization, I am still uncertain how I feel about it. But, I do love taking Coursera courses.Select the audit course option to not pay for the courseBootcamps and (...)
Semantic Versioning 101
▻https://hackernoon.com/semantic-versioning-101-d2623083714b?source=rss----3a8144eabfe3---4
Semantic Versioning 2.0.0 (semver.org) is a robust and elementary standard that encapsulates a wealth of information about the software you’re publishing or consuming.Open source veterans know and understand the importance of this standard. If you’ve run a project in long-term maintenance mode, you come to realize its power one way or another. Still, enthusiastic, fast-moving dev teams like to find ways around this standard. I’ve seen more than a few engineers decide to invent their own ideas around major, minor, and patch increments. Their rationale is rooted in aesthetics or their own release schedule.A key principleAside from the concise and complete information at semver.org, it is critical to understand:Semantic versioning is for your consumers. It’s not for your release schedule or (...)
#python #nodejs #open-source #software-development #javascript
10 Great Articles On Data Science And Data Engineering
▻https://hackernoon.com/10-great-articles-on-data-science-and-data-engineering-d5abdf4a4a44?sour
Data science and #programming are such rapidly expanding specialities it is hard to keep up with all the articles that come out from Google, Uber, Netflix and one off engineers. We have been reading several over the past few weeks and wanted to share some of our top blog posts for this week April 2019!We hope you enjoy these articles.Building and Scaling Data Lineage at NetflixBy: Di Lin, Girish Lingappa, Jitender AswaniImagine yourself in the role of a data-inspired decision maker staring at a metric on a dashboard about to make a critical business decision but pausing to ask a question — “Can I run a check myself to understand what data is behind this metric?”Now, imagine yourself in the role of a software engineer responsible for a micro-service which publishes data consumed by few critical (...)
Building a #serverless Data Pipeline with #aws S3 Lamba and DynamoDB
▻https://hackernoon.com/build-a-serverless-data-pipeline-with-aws-s3-lamba-and-dynamodb-5ecb8c3e
AWS Lambda plus Layers is one of the best solutions for managing a data pipeline and for implementing a serverless architecture. This post shows how to build a simple data pipeline using AWS Lambda Functions, S3 and DynamoDB.What this pipeline accomplishes?Every day an external datasource exports data to S3 and imports to AWS DynamoDB table.PrerequisitesServerless frameworkPython3.6PandasdockerHow this pipeline worksOn a daily basis, an external data source exports data of the pervious day in csv format to an S3 bucket. S3 event triggers an AWS Lambda Functions that do ETL process and save the data to DynamoDB.Install Serverless FrameworkBefore getting started, Install the Serverless Framework. Open up a terminal and type npm install -g serverless to install Serverless framework.Create (...)
Running #selenium and Headless Chrome on #aws Lambda Layers
▻https://hackernoon.com/running-selenium-and-headless-chrome-on-aws-lambda-layers-python-3-6-bd8
Selenium and Headless Chrome on AWS Lambda LayersAWS has extended the timeout limit for Lambda functions from 5 to 15 minutes, also AWS released new Lambda layers feature at re:Invent 2018, with these new features, we can now move Selenium tests to server-less frameworks without any performance issues!After many attempts of using different version of chrome drivers and binaries — I eventually find a way to get it work — ChromeDriver was able to run and interact with Headless Chrome inside a Lambda Layer.I created #serverless Framework (≥1.34.0) project to publish and use Lambda Layers with Selenium and Headless Chrome, thus team is able to do UI test using Python without running Selenium on server or local machine.Selenium and Headless ChromeIncompatible versions of serverless-chrome, (...)
#learning Data Science : Our Favorite Data Science #books
▻https://hackernoon.com/learning-data-science-our-favorite-data-science-books-d02ada5ed5d?source
Originally Posted HereWhether you are just breaking into data science, or you are looking to improve your data science skills. Books are one great method to get a base level understanding of specific topics. Now, we personally believe nothing beats experience, but in lieu of that, taking a course or reading a book is a great way possibilities that you can build on later when you are trying to practically approach data science.In data science, there are many topics to cover, so we wanted to focused on several specific topics. This post will cover books on #python, R programming, big data, SQL and just some generally good reads for data scientists.Heads Up! — This post contains referral links from Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a (...)
How I finally started learning new things like #cryptography
▻https://hackernoon.com/learning-new-things-like-cryptography-ebabc87c8b8?source=rss----3a8144ea
My experience taking the course Cryptography I by Stanford as offered by Coursera.The first rule of cryptography is never to implement one yourself. “It’s going to get crushed to dust by anyone who knows what they’re doing”mithi/simple-cryptographyLife as I’ve known itI do believe that everyone deep down at one point in their lives has thought that Cryptography — the art of writing and solving codes — is fascinating and considered learning more about it. People want to keep secrets safe, and people want to know the secrets of others.When I was a young child, as a game, my friends and I used to make “cipher algorithms”. These were basically just substitution ciphers with a few complicated but totally useless rules added. It’s embarrassing and quite frankly stupid, but I guess we had fun like with most (...)
#learning Data Science : Our Favorite #python Resources
▻https://hackernoon.com/learning-data-science-our-favorite-python-resources-from-free-to-not-877
Python is a common language that is used by both data engineers and data scientists. This is because it can automate the operational work that data engineers need to do and has the algorithms, analytics, and data visualization libraries required by data scientist.In both rolls, the need to manage, automate and analyze data is made easier by only a few lines of code. So much so that one of the books we have read and seen in many data focused practitioners libraries in the book Automate The Boring Stuff With Python.The book covers python basics and some simple automation tips. This is especially good for business analysts who work heavily in Excel.There are also books by O’Reilly that are also a great overview of the basics.You can start your list of books with the Python Cookbook. This (...)
How to FaaS like a pro: 12 uncommon ways to invoke your #serverless functions on #aws [Part 1]
▻https://hackernoon.com/how-to-faas-like-a-pro-12-uncommon-ways-to-invoke-your-serverless-functi
Yes, this is you at the end of this article, contemplating new possibilities! [Photo by Joshua Earle on Unsplash]If you feel like skipping the brief introduction below, you can jump straight to the first four uncommon trigger with these shortlinks:Amazon Cognito User Pools — Users management & custom workflowsAWS Config — Event-driven configuration checksAmazon Kinesis Data Firehose — Data ingestion & validationAWS CloudFormation — IaC, Macros & custom transformsA bit of history firstWhen AWS Lambda became generally available on April 9th, 2015 it became the first Function-as-a-Service out there, and there were only a few ways you could trigger your functions besides direct invocation: Amazon S3, Amazon Kinesis, and Amazon SNS. Three months later we got Amazon API Gateway support, (...)
Why is Python Used for Machine Learning?
▻https://hackernoon.com/why-is-python-used-for-machine-learning-773aaaadd0ea?source=rss----3a814
You might have heard about the python which is the topmost programming language of the computers. It is a high-level programming language which is having dynamic semantics. As it, language is very easy and readable, so it reduces the cost of program maintenance.As Python is considered to be the simplest programming language of all, its usage is also ranked in the topmost place. In regard to this, a few seconds are needed to spend at the below-given graph:One of the major advantages of its being easy is that it is very easy to interface with other languages as well particularly with C and C++. So let’s spend our little time to know what is the impact of using Python for machine learning.Have a look below:▻https://medium.com/media/f75e2226e309ed615490fe00e506261c/hrefWhy python holds an (...)
#python-for-ml #machine-learning-python #python-development #python-ml #python-and-ml
Histogram Equalization in #python from Scratch
▻https://hackernoon.com/histogram-equalization-in-python-from-scratch-ebb9c8aa3f23?source=rss---
Histogram Equalization is one of the fundamental tools in the image processing toolkit. It’s a technique for adjusting the pixel values in an image to enhance the contrast by making those intensities more equal across the board. Typically, the histogram of an image will have something close to a normal distribution, but equalization aims for a uniform distribution. In this article, we’re going to program a histogram equalizer in python from scratch. If you want to see the full code, I’ve included a link to a Jupyter notebook at the bottom of this article. Now, if you’re ready, let’s dive in!Before anything, we have to do some setup. Let’s import the libraries we’ll be using throughout the program, load in the image, and display (...)
#image-processing #computer-vision #hackernoon-top-story #development
10 Great Articles On Data Science And #programming!
▻https://hackernoon.com/10-great-articles-on-data-science-and-programming-eec816941896?source=rs
Data science and programming are two topics that continue to expand and evolve as computation, knowledge bases and best practices continue to improve. This makes it very difficult to keep up with all the new articles and bodies of thought. So We compiled a list of 10 articles we or other people have enjoyed in the past year or so on the topics of programming, data science and machine learning. We hope they provide you new perspective as well as practical advice.1. Why businesses fail at machine learningby Cassie KozyrkovImagine hiring a chef to build you an oven or an electrical engineer to bake bread for you. When it comes to machine learning, that’s the kind of mistake I see businesses making over and over.If you’re opening a bakery, it’s a great idea to hire an experienced baker (...)
Bien configurer ses #Tests #Python avec tox et Travis
▻https://makina-corpus.com/blog/metier/2019/bien-configurer-ses-tests-python-avec-tox-et-travis
Le plus difficile dans le développement des tests unitaires c’est souvent de se motiver à écrire les premières lignes... Alors qu’une fois que c’est initié, ça devient très simple d’en ajouter. Nous verrons dans cet article de blog comment le faire rapidement avec tox et Travis !
i-1000th idea to make money online via #python-chained sqlmaps!
▻https://hackernoon.com/i-1000th-idea-to-make-money-online-via-python-chained-sqlmaps-c8793a6897
My i-1000th idea to make money online came to me one morning when playing around with Kali tools and gaining access to stuff I shouldn’t have access to. There was a little bit of a moral dilemma that came to play when I thought to myself about the opportunity to see if someone’s password was re-used on other sites when I found 10s 1000s of them in plain text, or create a mailing list to sell like merchandise from lists of 10s 1000s emails on different sites online… but I thought I’d take the whitehat approach and see if I could make people aware of some of their security holes in exchange for the opportunity to sell them security solutions.#1) Create a #pentesting automated script that identifies open databases or other security holesThere’s myriad tools that come to mind to make this (...)
Commit, push, deploy — #git in the Microsoft #azure #cloud
▻https://hackernoon.com/commit-push-deploy-git-in-the-microsoft-azure-cloud-403fb135bcf4?source=
Commit, push, deploy — Git in the Microsoft Azure CloudFollow me on Twitter, happy to take your suggestions on topics or improvements /ChrisWe have come to rely on Git as our default version control tool ever since it was released, it has become de facto standard even if other options exist. Git helps us manage our source code, divide it in branches and it even helps us working with other developers on places like for example GitHub or GitLab by allowing us to create Pull/Merge requests. Wouldn’t it be great if Git can be there for us when we move our Apps to the Cloud?This article will cover the following:Download a sample app, we want to focus on understanding #deployment with Git so we will take some ready-made codeRun the app locally just to ensure it works, this is a must, if it works (...)
Taking Data Visualization to Another Level
▻https://hackernoon.com/taking-data-visualization-to-another-level-4d1c47bb01a2?source=rss----3a
Courtesy: ▻https://pixabay.com/illustrations/background-data-network-web-3228704/When you tend to use one library for a certain period of time, you get used to it. But, you need to evolve and learn something new every day. If you are still stuck up with Matplotlib(Which is amazing), Seaborn(This is amazing too), Pandas(Basic, yet easy Visualization) and Bokeh, You need to move on and try something new. Many amazing visualization libraries are available in #python, which turns to be very versatile. Here, I’m going to discuss about these amazing libraries:PlotlyCufflinksFoliumAltair + VegaD3.js (My best Pick, i code in JS too)If you are aware and use the libraries mentioned above then you are on the right track of evolution. They can help in generating some amazing visualizations and syntax (...)
#javascript #data-visualization #data-analysis #data-science
Linear Programming in #python : A Straight Forward #tutorial
▻https://hackernoon.com/linear-programming-in-python-a-straight-forward-tutorial-a0d152618121?so
Linear programming is one of the most common #optimization techniques. It has a wide range of applications and is frequently used in operations research, industrial design, planning, and the list goes on. Alas, it is not as hyped as machine learning is (which is certainly a form of optimization itself), but is the go-to method for problems that can be formulated through decision variables that have linear relationships. This is a fast practical tutorial, I will perhaps cover the Simplex algorithm and the theory in a later post.Problem StatementJust to get an idea, we are going to solve a simple problem regarding production scheduling. Imagine that you work for a company that builds computers. A computer is a fairly complex product, and there are several factories that assemble them (...)