Intersting links about deep learning

general

• http://jalammar.github.io/
• https://lilianweng.github.io/lil-log/
• http://colah.github.io/posts/2014-03-NN-Manifolds-Topology/
• fast.ai updated for 2020 an V2
• fastai book
• dive into deep learning
• Yes you should understand backprop
• CS 329S: Machine Learning Systems Design

critique

• Vincent Warmerdam: The profession of solving (the wrong problem) | PyData Amsterdam 2019
• A Recipe for Training Neural Networks

generic ML useful tools

• GradIO - visual interface to explore models and to collect feedback

constraints

• https://www.unofficialgoogledatascience.com/2020/11/adding-common-sense-to-machine-learning.html

graph neural networks

• https://medium.com/dair-ai/an-illustrated-guide-to-graph-neural-networks-d5564a551783
• [node classification with pytorch geometric] (https://colab.research.google.com/drive/14OvFnAXggxB8vM4e8vSURUp1TaKnovzX?usp=sharing#scrollTo=dszt2RUHE7lW)

frameworks

graphs

• deep graph geometric DGL
• pytorch geometric
• http://web.stanford.edu/class/cs224w/

time-series

• sktime and sktime-dl
• pytorch-forecasting
• A Multivariate Deep Learning for Time Series Forecasting Library
• tsai state of the art sequence modeling
• GluonTS - Probabilistic Time Series Modeling in Python
• Awesome python time-series tooling not so much neural networks. But still very useful feature generators.
• ROCKET transforms time series using random convolutional kernels
• Orion - multivariate time-series anomaly detection
• How to prepare Time Series Data for LSTM Networks
• neural prophet

Varous time-series handling approaches:

• transformer https://www.youtube.com/watch?v=GiD87DeadYY
• 1D CNN, convert to images, convert to text https://www.youtube.com/watch?v=WoLlZLdoEQk
• Attention & time-series review https://towardsdatascience.com/attention-for-time-series-classification-and-forecasting-261723e0006d
• transformer:
  • https://github.com/maxjcohen/transformer
• classificaton:
  • https://github.com/hfawaz/dl-4-tsc/
  • flight profiles (time-series) rendered as images https://closedloopai.github.io/portfolio/airline%20industry/deep%20learning/time%20series/image%20classification/cnn/rnn/python/fastai/matlab/2019/09/15/TimeSeriesClassification.html

self supervised learing

• BYOL https://towardsdatascience.com/easy-self-supervised-learning-with-byol-53b8ad8185d

anomaly detection

• Deep Few-shot Anomaly Detection https://towardsdatascience.com/deep-few-shot-anomaly-detection-b33f130d1f80

useful resources

tutorials

• https://github.com/curiousily/Getting-Things-Done-with-Pytorch

hardware

• http://timdettmers.com/2020/09/07/which-gpu-for-deep-learning/