Roundup
04 Jul 2019

Lynx Roundup, July 4th 2019

Statistical model of software project length! Open source AI bionic leg! Statistical mistakes Data Scientists make!
Lynx Roundup, July 4th 2019

https://arxiv.org/pdf/1904.03241.pdf

https://erikbern.com/2019/04/15/why-software-projects-take-longer-than-you-think-a-statistical-model.html

https://www.technologyreview.com/f/610195/ubers-algorithm-for-paying-drivers-is-causing-a-gender-gap/

https://jalopnik.com/lyft-was-full-of-shit-and-now-its-stinking-rich-1833669329

https://qz.com/1636413/an-open-source-ai-bionic-leg-is-the-future-of-prosthetics/

https://www.kdnuggets.com/2019/06/statistics-mistakes-data-scientists.html

https://towardsdatascience.com/how-to-use-ggplot2-in-python-74ab8adec129

Continue Reading
Roundup
03 Jul 2019

Lynx Roundup, July 3rd 2019

Bees can link symbols to numbers! Machine learning with KSQL! Carbon footprint of training ML models!
Lynx Roundup, July 3rd 2019

https://twitter.com/hillelogram/status/1119709859979714560

https://github.com/shawnbrown/datatest

https://www.sciencealert.com/tiny-bee-brains-seem-to-be-able-to-link-symbols-to-numbers

https://twitter.com/stoppostmates/status/1129895580594049025

https://medium.com/homeaway-tech-blog/ml-in-ksql-a44d455b0687

https://www.technologyreview.com/s/613630/training-a-single-ai-model-can-emit-as-much-carbon-as-five-cars-in-their-lifetimes/

https://www.sciencealert.com/astonishing-new-study-treats-alzheimer-s-in-mice-with-a-light-and-sound-show

Continue Reading
Roundup
01 Jul 2019

Lynx Roundup, July 1st 2019

Unraveling the JPEG! Standardization and scaling schemes! Datasets for Geometric Deep Learning!
Lynx Roundup, July 1st 2019

https://parametric.press/issue-01/unraveling-the-jpeg/

https://blog.acolyer.org/2019/04/17/teaching-rigorous-distributed-systems-with-efficient-model-checking/

https://truthout.org/articles/explosion-of-interest-in-worker-cooperatives-drives-economic-changes/

https://www.businessinsider.com/amazon-system-automatically-fires-warehouse-workers-time-off-task-2019-4

https://medium.com/netflix-techblog/python-at-netflix-bba45dae649e

https://medium.com/@swethalakshmanan14/how-when-and-why-should-you-normalize-standardize-rescale-your-data-3f083def38ff

https://medium.com/ai³-theory-practice-business/abc-free-datasets-for-geometric-deep-learning-5e2995768b37

Continue Reading
Roundup
30 Jun 2019

Lynx Roundup, June 30th 2019

Styling Pandas! Data Science Workflow! Smart contracts with Truffle!
Lynx Roundup, June 30th 2019

https://www.truffleframework.com/

https://pbpython.com/styling-pandas.html

https://slate.com/technology/2019/05/uber-strike-victory-drivers-network.html

https://www.theatlantic.com/science/archive/2019/05/engineered-viruses-cured-a-dying-girls-infections/589075/

https://www.quora.com/Why-does-Quora-use-MySQL-as-the-data-store-instead-of-NoSQLs-such-as-Cassandra-MongoDB-or-CouchDB-Are-they-doing-any-JOINs-over-MySQL-Are-there-plans-to-switch-to-another-DB

https://www.quora.com/What-is-the-process-you-follow-for-successful-data-science-poc-projects/answer/Håkon-Hapnes-Strand

https://www.nongnu.org/txr/

Continue Reading
Roundup
28 Jun 2019

Lynx Roundup, June 28th 2019

Open Sourcing your project! Gameboy ROM Builder! FPGA Development for Software Engineers!
Lynx Roundup, June 28th 2019

https://www.reddit.com/r/dataisbeautiful/comments/bh1idk/food_group_macros_oc/

https://medium.freecodecamp.org/from-a-python-project-to-an-open-source-package-an-a-to-z-guide-c34cb7139a22

https://www.engadget.com/2019/04/22/gameboy-gbstudio-ROM-game-builder/

https://www.mdpi.com/1099-4300/19/5/188

https://splinternews.com/the-one-collar-movement-1834217129

https://twitter.com/Rainmaker1973/status/1119136849765601280

https://www.embedded.com/electronics-blogs/say-what-/4458785/CPU-plus-FPGA-design-flow-for-software-developers--A-new-tangible-reality

Continue Reading
Roundup
27 Jun 2019

Lynx Roundup, June 27th 2019

Satellite data and commodities trading! Design and Machine Learning! People-First Machine Learning!
Lynx Roundup, June 27th 2019

https://www.reddit.com/r/MachineLearning/comments/byo092/d_design_skills_in_ml_research/

https://towardsdatascience.com/when-to-buy-the-dip-e2e128d737a7

http://www.win-vector.com/blog/2019/05/free-video-lecture-vectors-for-programmers-and-data-scientists/

https://medium.com/bloomberg/satellites-are-reshaping-how-traders-track-earthly-commodities-2734a5ff03c7

https://knowledge.wharton.upenn.edu/article/people-first-artificial-intelligence-strategy/

https://spectrum.ieee.org/tech-talk/computing/hardware/for-specialized-optimizing-machines-its-all-in-the-connections

https://towardsdatascience.com/jupyter-is-the-new-excel-a7a22f2fc13a

Continue Reading
Roundup
26 Jun 2019

Lynx Roundup, June 26th 2019

Multivariate calculus and Machine Learning! Calculation vs measurement! Lots of cool explorable visualizations!
Lynx Roundup, June 26th 2019

https://jeremykun.com/2019/06/08/math-versus-data/

https://cleantechnica.com/2019/06/12/confessions-of-a-climate-activist-dont-blame-yourself-go-after-the-criminals-who-sold-out-humanity-for-profit/

https://medium.com/fintechexplained/calculus-multivariate-calculus-and-machine-learning-242b9efcb41c

https://twitter.com/keeeto2000/status/1130065817780068353

https://eng.uber.com/research/keeping-master-green-at-scale/

http://wordsandbuttons.online/index.html

https://alistapart.com/article/nothing-fails-like-success/

Continue Reading
Roundup
25 Jun 2019

Lynx Roundup, June 25th 2019

Better Exploratory Data Analysis with Pandas-Profiling! Chaos and prediction! Non-normally distributed errors!
Lynx Roundup, June 25th 2019

https://newrepublic.com/article/153744/gig-economy

https://towardsdatascience.com/speed-up-your-exploratory-data-analysis-with-pandas-profiling-88b33dc53625

https://www.gamesindustry.biz/articles/2019-05-08-united-devs-stand-divided-they-crunch-opinion

https://realpython.com/learning-paths/data-science-python-core-skills/

https://egtheory.wordpress.com/2019/06/15/hiding-behind-chaos/

https://www.quora.com/In-linear-regression-it-is-generally-assumed-that-the-errors-are-distributed-normally-with-unknown-variance-hence-the-regression-coefficient-t-stats-have-the-t-distribution-if-the-null-hypothesis-is-true-But-what-if

https://go.technologyreview.com/can-machine-learning-help-us-understand-why

Continue Reading
Spark
24 Jun 2019

Performing Macro Operations on PySpark DataFrames

Perform SQL-like joins and aggregations on your PySpark DataFrames.
Performing Macro Operations on PySpark DataFrames

We've had quite a journey exploring the magical world of PySpark together. After covering DataFrame transformations, structured streams, and RDDs, there are only so many things left to cross off the list before we've gone too deep.

To round things up for this series, we're a to take a look back at some powerful DataFrame operations we missed. In particular we'll be focusing on operations which modify DataFrames as a whole, such as  

Joining DataFrames in PySpark

I'm going to assume you're already familiar with the concept of SQL-like joins. To demonstrate these in PySpark, I'll create two simple DataFrames:

Continue Reading
Roundup
23 Jun 2019

Lynx Roundup, June 23rd 2019

Web-based FPGA environment! Building Data Engineering skills! Watch photons dance along qubits!
Lynx Roundup, June 23rd 2019

https://arstechnica.com/science/2019/05/photons-dance-along-a-line-of-superconducting-qubits/

https://techxplore.com/news/2019-06-infusing-machine-inductive-biases-capture.html

https://www.kickstarter.com/projects/ryanmjacobs/webfpga-rapid-fpga-development-system

https://earther.gizmodo.com/exxon-predicted-2019-s-ominous-co2-milestone-in-1982-1834748763

https://www.nytimes.com/2019/05/20/science/social-class-confidence.html

https://www.reddit.com/r/datascience/comments/bk1drz/how_to_build_devdata_engineering_skills/

https://twitter.com/MurderBryan/status/1120759895748378627

Continue Reading
Roundup
22 Jun 2019

Lynx Roundup, June 22nd 2019

Intro to Reinforcement Learning! Google's Theorem Prover! Mathematical Optimization!
Lynx Roundup, June 22nd 2019

https://www.gofundme.com/f/solidarity-fund-for-fired-fb-contingent-workers

https://talkingpointsmemo.com/features/privatization/four/

https://themindcircle.com/jigsaw-puzzle-companies-use-the-same-patterns/

https://blog.floydhub.com/an-introduction-to-q-learning-reinforcement-learning/

https://www.newscientist.com/article/2200707-google-has-created-a-maths-ai-that-has-already-proved-1200-theorems/

https://www.kdnuggets.com/2019/04/how-optimization-works.html

https://aws.amazon.com/blogs/big-data/emr-notebooks-a-managed-analytics-environment-based-on-jupyter-notebooks/

Continue Reading
Roundup
21 Jun 2019

Lynx Roundup, June 21st 2019

Linear Programming in Python! EEGs with Arduino! SUPER fast RegEx with BlingFire!
Lynx Roundup, June 21st 2019

https://towardsdatascience.com/linear-programming-and-discrete-optimization-with-python-using-pulp-449f3c5f6e99

https://github.com/Microsoft/BlingFire

https://github.com/awslabs/gluon-ts

https://killscreen.com/articles/build-better-mousetrap/

https://medium.com/@kevinjycui/emotiv-arduino-developing-with-eegs-in-engineering-8c0688b720f5

http://cs.brown.edu/courses/cs195y/2019/

https://github.com/3b1b/manim

Continue Reading