#+TITLE: Machine Learning Tools for learning machine learning. Obviously, this will expand into many files once I've developed more knowledge. * Papers https://github.com/NathanUA/U-2-Net salient object detection https://github.com/pliang279/awesome-multimodal-ml reading about multimodal ml * Tutorials https://github.com/fzenke/spytorch gradient learning for spiking neural networks * Utilities https://github.com/joseph-zhong/LipReading yes https://github.com/RasaHQ/rasa ml framework for automating text conversations * ETC [[https://numenta.com/blog/2019/08/30/case-for-sparsity-in-neural-networks-part-1-pruning][The case for sparsity in neural networks, Part 1: Pruning]] [[https://github.com/karpathy/micrograd][ tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API]] https://stites.io/ -- great writing on neural networks [[https://pjreddie.com/darknet/][Darknet: Open Source Neural Networks in C]] [[https://karpathy.github.io/2019/04/25/recipe/][A Recipe for Training Neural Networks]] [[https://deepmind.com/blog/article/Towards-understanding-glasses-with-graph-neural-networks][Towards understanding glasses with graph neural networks | DeepMind]] [[http://neuralnetworksanddeeplearning.com/][Neural networks and deep learning]] https://machinelearningmastery.com/learn-add-numbers-seq2seq-recurrent-neural-networks/ https://www.reddit.com/r/MachineLearning/comments/6l2esd/d_why_cant_you_guys_comment_your_fucking_code/ [[https://forbes.com/sites/igorbosilkovski/2020/07/14/meet-the-stanford-ai-lab-alums-that-raised-15-million-to-optimize-machine-learning/amp?__twitter_impression=true][Meet The Stanford AI Lab Alums That Raised $15 Million To Optimize Machine Learning]] [[https://www.reddit.com/r/MachineLearning/comments/i1aafb/p_i_trained_a_gan_to_generate_photorealistic_fake/][[P] I trained a GAN to generate photorealistic fake penises - MachineLearni]] [[https://github.com/h2oai/h2o-3][h2oai/h2o-3: Open Source Fast Scalable Machine Learning Platform For Smarte]] [[https://www.forbes.com/sites/igorbosilkovski/2020/07/14/meet-the-stanford-ai-lab-alums-that-raised-15-million-to-optimize-machine-learning/amp/?__twitter_impression=true][https://www.forbes.com/sites/igorbosilkovski/2020/07/14/meet-the-stanford-ai-lab-alums-that-raised-15-million-to-optimize-machine-learning/amp/?__twitter_impression=true]] [[https://link.springer.com/book/10.1007/978-1-4302-5990-9?utm_source=twitter&utm_medium=social&utm_content=organic&utm_campaign=BBKK_1_DL01_GL_twitterorganic&sf234521345=1][book by rahul khanna]] [[https://news.ycombinator.com/item?id=23345379][gpt 3]] https://www.reddit.com/r/MachineLearning/comments/i1aafb/p_i_trained_a_gan_to_generate_photorealistic_fake/ fun with generating gans http://blog.ezyang.com/2013/01/nlp-the-missing-framework/ https://minimaxir.com/2019/09/howto-gpt2/ -- fun gpt 2 training time https://ezyang.github.io/convolution-visualizer/index.html https://www.reddit.com/r/MachineLearning/comments/gc834u/d_programming_language_choices_in_ai_nlp_and https://www.reddit.com/r/compsci/comments/g1eivp/from_cvpr_2020_turn_any_picture_to_a_3d_photo/ https://github.com/tokee/juxta https://www.reddit.com/r/compsci/comments/g8circ/a_repository_of_graph_classification_research/ https://arxiv.org/abs/2004.14545 https://arxiv.org/abs/2004.10934/ [[https://software.intel.com/content/www/us/en/develop/training/course-machine-learning.html][intels introductory ml course]] [[https://www.youtube.com/watch?v=d8ZDjuqo0R8&app=desktop][simple ml mindsweeper]] [[https://github.com/intel/dlafs][stream accel framework]] https://en.wikipedia.org/wiki/Discrete_cosine_transform signal processing: the discrete cosine transformation https://en.wikipedia.org/wiki/Discrete_cosine_transform data compression with fourier methods https://julialang.org/blog/2017/12/ml-pl/# https://www.youtube.com/watch?v=hx7kvTZLHYI https://www.youtube.com/watch?v=HgDdaMy8KNE whaaaat https://minimaxir.com/2019/09/howto-gpt2/ -- make text with gpt2! [[https://stackoverflow.com/questions/2268885/machine-learning-in-ocaml-or-haskell#2308361][ml with cool functional languages]] https://www.youtube.com/watch?v=Jr9sptoLvJU&app=desktop ** natural language processing https://www.reddit.com/r/compsci/comments/g1y5af/cmu_deepmind_googles_xtreme_benchmarks/ http://brainstormingbox.org/what-do-you-think-about-natural-language-processing/ https://blog.benwiener.com/programming/2019/04/29/reinventing-the-wheel.html discovering optimal rolling shape in pytorch! https://minimaxir.com/2020/01/twitter-gpt2-bot/ https://github.com/alimir1/ml/blob/master/index.md framework for learning machine learning and self studying * GPT [[https://github.com/minimaxir/aitextgen][A robust Python tool for text-based AI training and generation using GPT-2.]] [[https://t.co/w8JkrZO4lk][Sharif Shameem on Twitter: "This is mind blowing. With GPT-3, I built a lay]] [[https://www.gwern.net/GPT-3][GPT-3 Creative Fiction · Gwern.net]] [[http://lacker.io/ai/2020/07/06/giving-gpt-3-a-turing-test.html][Giving GPT-3 a Turing Test]] [[https://github.com/thesofakillers/GPTrue-or-False][A browser extension that displays the GPT-2 Log Probability of selected text]] [[https://t.co/w8JkrZO4lk][Sharif Shameem on Twitter: "This is mind blowing. With GPT-3, I built a lay]] * AI [[https://amp.reddit.com/r/AIDungeon/comments/hpkqij/using_the_dragon_module_i_just_generated_what_is/#click=https://t.co/io3jW7sgJm][Reddit - AIDungeon - Using the Dragon Module, I just generated what is hand]] [[https://medium.com/@aidungeon/ai-dungeon-dragon-model-upgrade-7e8ea579abfe][AI Dungeon: Dragon Model Upgrade. You can now play AI Dungeon with one of… ]] * GAN [[https://www.gwern.net/Faces][Making Anime Faces With StyleGAN · Gwern.net]] [[https://github.com/tmlabonte/tendies]["TensorFlow Distributed Image Serving - A lightweight, RESTful remote inference library for decoupling deep learning development and deployment. Example usage cases with CycleGAN and Faster R-CNN. Includes tutorial ipynbs."]] [[https://reddit.com/r/MachineLearning/comments/huyp4d/n_the_lisbon_ml_school_starts_tomorrow_talks_will]] https://www.reddit.com/r/learnmachinelearning/comments/hxxtik/ai_application_python_implementation_of_proximal/ https://www.reddit.com/r/magicTCG/comments/ht0o1f/oc_lands_painted_by_an_artificial_intelligence/ https://github.com/evhub/minecraft-deep-learning https://github.com/jasonmayes/Real-Time-Person-Removal https://github.com/facebookresearch/Hanabi_SPARTA https://github.com/OpenMined/PySyft https://github.com/koursaros-ai/nboost [[https://github.com/strib/scigen][an automatic paper generator]] https://github.com/evvo-labs/evvo distributed evolutionary algorithms [[https://github.com/huggingface/transformers][nlp transformer model]] https://github.com/una-dinosauria/human-motion-prediction human motion prediction https://github.com/KartikChugh/Otto [[https://github.com/facebookresearch/detr][End-to-End Object Detection with Transformers]] https://github.com/HumanCompatibleAI/evaluating-rewards https://github.com/paruby/snake-face [[file:web_design.org][Web Design]] [[https://github.com/ajaynagesh/mean-teacher][semi-supervised learning architecture]] https://github.com/facebookresearch/dlrm deep learning recommendation model https://github.com/chiphuyen/machine-learning-systems-design machine learning systems design [[https://github.com/byungsook/neural-flow-style][Neural Style Transfer for Fluids]] [[https://blog.benwiener.com/programming/2019/04/29/reinventing-the-wheel.html][discovering optimal rolling shape in pytorch!]] [[https://news.ycombinator.com/item?id=23250379][openai langauge model used for code generation]] https://github.com/semi-technologies/weaviate vector search engine for scaling ml models [[https://github.com/aigagror/discriminator-style-transfer][discriminator style transfer]] [[https://github.com/johnwmillr/Facer][face averaging]] [[https://github.com/NeuroTechX/eeg-notebooks][eeg experiments in python and jupyter notebooks]] [[https://github.com/benedekrozemberczki/role2vec][role2vec]] [[https://github.com/openai/gym][OpenAI Gym]] [[https://github.com/gengjia0214/jai]['Lego style' pytorch deep learning model for CNNs]] [[https://github.com/google-research/lag][latent adversarial generation of high resolution images]] [[https://github.com/openai/gpt-3][gpt-3]] [[https://github.com/commaai/openpilot][open source driver assistance system, openpilot]] [[https://github.com/werner-duvaud/muzero-general][muzero paper]] [[https://quasarbright.github.io/MachineLearning/README][gan work]] [[https://github.com/h2oai/h2o-3][h2oai/h2o-3]] [[https://colah.github.io/posts/2015-08-Understanding-LSTMs][Understanding LSTM Networks]] [[https://jim-stone.staff.shef.ac.uk/BookBayes2012/books_by_jv_stone/index.html][Artificial Intellgence Engines]] [[https://web.stanford.edu/class/cs330/][CS 330 Deep Multi-Task and Meta Learning]] [[https://github.com/mdroste/stata-pylearn][mdroste/stata-pylearn: Supervised learning algorithms in Stata]] [[https://course.fullstackdeeplearning.com/][Full Stack Deep Learning - Full Stack Deep Learning]] [[https://colah.github.io/posts/2015-08-Understanding-LSTMs/][Understanding LSTM Networks -- colah's blog]] [[https://github.com/jantic/DeOldify][jantic/DeOldify: A Deep Learning based project for colorizing and restoring]] https://openai.com/blog/image-gpt/ [[[[https://raw.githubusercontent.com/jethrokuan/braindump/master/org/actor_critic.org][https://raw.githubusercontent.com/jethrokuan/braindump/master/org/actor_critic.org]]] [actor-critic methods]] [[https://qnkxsovc.github.io/concepts/2018/06/25/EPR-Strange-Paradox.html][EPR: The Strange Paradox of Distance and Observation | qnkxsovc Blog]] [[https://qnkxsovc.github.io/projects/2018/04/30/Explanation-Convolutions-Multi-Feature-Maps.html][Explanation: Convolutions on Feature Maps With Multiple Channels | qnkxsovc]] [[https://qnkxsovc.github.io/concepts/2018/03/23/Word2Vec-Part-2-Color-Vectors.html][Word2Vec Part 2: Color Vectors | qnkxsovc Blog]] [[https://qnkxsovc.github.io/concepts/2018/02/18/Word-Vectors-From-the-Ground-Up.html][Word Vectors, From the Ground Up | qnkxsovc Blog]] [[https://reddit.com/r/opengl/comments/hwntc1/following_learnopenglcom_but_my_triangles_being][Following learnopengl.com but my triangles being culled weirdly. Code in comments]] https://blogs.nvidia.com/blog/2020/05/22/gamegan-research-pacman-anniversary/ https://people.cs.umass.edu/~arjun/main/home/ https://jelv.is/ https://www.aquicarattino.com/blog/how-write-programming-book/ [[https://course.fullstackdeeplearning.com][Full Stack Deep Learning]] [[https://en.m.wikipedia.org/wiki/Boltzmann_machine][boltzmann machine: recurrent neural networking]] [[https://lczero.org/][neural networ chess engine]] https://github.com/alec-tschantz/predcoding predictive coding [[file:programming-languages.org][Programming Languages]] [[https://ai.googleblog.com/2018/07/improving-connectomics-by-order-of.html?m=1][improving connectonomics]] https://news.ycombinator.com/item?id=23032243 openai jukebox: generative music styles![[file:music.org][Music]] [[https://arxiv.org/abs/1805.09501][autoaugment: learning augmentation policices from data]] [[https://qnkxsovc.gitlab.io/prob-vis/][statistical distances and gan training]] [[https://github.com/google-research/torchsde][PyTorch Implementation of Differentiable SDE Solvers]] [[https://blog.jethro.dev/posts/remembrance_agents][Experimenting with Remembrance Agents]] [[file:emacs.org][Emacs]] [[https://arxiv.org/abs/1911.01382][Amortized Population Gibbs Samplers with Neural Sufficient Statistics]] https://www.reddit.com/r/artificial/comments/gxrnhq/d_paper_explained_synthetic_petri_dish_a_novel/ https://towardsdatascience.com/the-unreasonable-ineffectiveness-of-deep-learning-on-tabular-data-fd784ea29c33 https://www.indexventures.com/perspectives/rebirth-robotics-how-covariant-unlocks-power-deep-learning-robots/ https://codeplay.com/ https://remis.io/ https://keras.io/examples/audio/speaker_recognition_using_cnn/ https://twitter.com/fchollet/status/1280733141980680193 [[https://github.com/theriley106/isMask.py][theriley106/isMask.py: Realtime Face Mask Detection in ~10 lines of Python Code]] https://tech.slashuot.org/story/20/06/21/1858251/facebook-research-releases-tech-to-create-3d-models-of-people-from-photographs https://github.com/worldmodels/worldmodels.github.io models of the world? [[https://github.com/alimir1/ml/blob/master/index.md][self taught machine learning study group and cirriculum]] https://www.nature.com/articles/nature14539 deep learning retro paper https://jkjung-avt.github.io/tensorrt-yolov4/ https://openai.com/blog/image-gpt/ https://oops.cs.columbia.edu/ predicting unintentional action in video https://yunzhuli.github.io/V-CDN/ causal discovery in systems from videos https://www.apaperaday.com/ a deep learning paper eery day https://news.ycombinator.com/item?id=24096154 https://news.ycombinator.com/item?id=24042150 idk what this is but it s https://github.com/vt-vl-lab/3d-photo-inpainting [[https://dickrnn.github.io/][dick rnn]]