Consulting - Quality
Difference makes the DIFFERENCE
basic source: PadhAI Course-ware
Link: https://padhai.onefourthlabs.in/
One Fourth Labs: YouTube Channel:
https://www.youtube.com/channel/
UC337_KN0yuNvzeZnlstEa_A/featured
- Make yourself familiar with the Python 3 datatypes, inbuilt data structures, control structures and functions using the following files:
https://www.youtube.com/watch?v=OMGt-jcMlCs
My view: The First video, that anyone, interested in Machine Learning or Artificial Intelligence courses, should listen, not just hear and understand. This video is from OneFourth Labs. - Brush up Python - Jupyter Notebook Link: http://bit.ly/ofl-python
- Brush up Python - Jupyter Notebook in PDF: Brush up Python.pdf
- Python introductory tutorial: https://beginnersbook.com/2018/03/python-tutorial-learn-programming/
- A Free introductory course on python for data science: https://www.datacamp.com/courses/intro-to-python-for-data-science
- Google python class: https://developers.google.com/edu/python
- Detailed python 3 documentation: https://docs.python.org/3/tutorial/
- Linear Algebra: http://www.deeplearningbook.org/contents/
linear_algebra.html - Calculus: http://wiki.fast.ai/index.php/Calculus
_for_Deep_Learning - Matrices and Calculus: https://explained.ai/matrix-calculus/index.html
- Checkout the following free courses in Khan Academy:
Linear Algebra: https://www.khanacademy.org/math/linear-algebra - Calculus Intro: https://www.khanacademy.org/math/calculus-1
- Multivariate Calculus: https://www.khanacademy.org/math/multivariable-calculus
- Link to install Math Plot Library: Here, we have the required commands to install respective
files. Here, we have examples, tutorials and APIs.
In Visual Studio Code environment, execute the given command from terminal:
at terminal in VSCode or at working Python working folder type (eg: C:/> pip install -U matplotlib)
https://matplotlib.org/users/installing.html
Mathplotlib gets installed. This needs internet connection.
https://matplotlib.org/index.html Link to install NumPy: NumPy is the fundamental package for scientific computing with Python. It contains among other things: a powerful N-dimensional array object; sophisticated ...
at c:/> pip install -U pip (pip is upgraded, if not already upgraded)
at C:/> pip install -U numpy
NumPy gets installed. This needs internet connection.
Link to Source: https://docs.scipy.org/doc/numpy/
user/quickstart.htmlhttps://angel.co/projects/518942-human-activity-recognition-machine-learning
http://robots.ox.ac.uk/~minhhoai/papers/
SegReg_CVPR11.pdf (I couldnot download this link, if you can, please send me a copy of the same)In general if we do not use sns.set(), the background would be plain while displaying the graph.
For a better visual understanding we use sns.set().
https://seaborn.pydata.org/tutorial/aesthetics.htmlAn Introduction to Statistical Learning -
http://www-bcf.usc.edu/~gareth/ISL/Google Machine Learning Course -
https://developers.google.com/machine-learning/crash-course/Essentials of Metaheuristics -
https://cs.gmu.edu/~sean/book/
metaheuristics/Essentials.pdf
- A few useful things to know about Machine Learning -
https://homes.cs.washington.edu/~pedrod/
papers/cacm12.pdf - A byte of Python eBook (to read on desktop): https://python.swaroopch.com/ It is easy to keep this book open on a browser and practice with Python command prompt or with any editors available. Pdf, Mobi, eBook links are also available towards the end of this webpage.
If the above link doesn't work, you can download pdf version from this link. - Installing NumPy on windows: This link provides with a clear description on installing NumPy package in windows environment.
http://web.cs.wpi.edu/~cs1004/c17/Resources/Windows/
SettingUpPython_Windows.pdf
(if this file is not found at the source, you can have it from this portal: Link to file) - Pdf File: (Adaptive Computation and Machine Learning) Kevin P. Murphy-Machine Learning_ A Probabilistic Perspective-The MIT Press (2012) - Link to PDF
- Pattern Recognition And Machine Learning -
Springer 2006 - Link to PDF - http://greenteapress.com/thinkstats2/thinkstats2.pdf
- Feature Engineering Book from O'Reilly. This book is of over 200 pages. It may be helpful for reference purpose.
Python Language Links
(primarily for my personal use...)
basic source: PadhAI Course-ware - Chat Group
Various other sources on Python, AI, DL and ML (Artificial Intelligence, Deep Learning and Machine Learning)
- One of the best places to learn python, AI and the related is: https://www.kaggle.com/learn/overview
“A Simple Neural Network from Scratch with PyTorch and Google Colab” by Elvis https://link.medium.com/i5BpfxQ4KT
https://pytorch.org/tutorials/beginner/nlp/
pytorch_tutorial.html- For newbies in Pytorch:
Tip: You type every single command mentioned in the docs to get the familiarity.
https://pytorch.org/tutorials/beginner/
deep_learning_60min_blitz.html - Pytorch free course
https://in.udacity.com/course/deep-learning-pytorch--ud188 - http://vision.stanford.edu/teaching/cs131_fall1617/
schedule.html - Udemy Deep Learning Prerequisites:
https://www.udemy.com/deep-learning-prerequisites-the-numpy-stack-in-python/
The Numpy, Scipy, Pandas, and Matplotlib stack: prep for deep learning, machine. https://airtable.com/invite/r/nfHfFokR
Airtable: Organize anything you can imagine
Airtable works like a spreadsheet but gives you the power of a database to organize anything. Sign up for free.The Resources page on this website contains a list of hand-selected goodies that are regularly recommended to both beginners and experts. https://pythondiscord.com/info/resources
Try to understand how these tutorials work https://www.tensorflow.org/tutorials
Run them with google colabUdacity Data Science Mega Link if anyone needs
https://mega.nz/#F!qrpxSIRD!PClG5ZMHdd5FroIFTT_Z5QCodecademy is another way to learn how to code. It's interactive, fun, and you can do it with your friends.https://www.codecademy.com/catalog/
language/pythonBest Books And Sites For Machine Learning
How to get started in machine learning? Python is here because if you are new to machine learning and new to programming then Python would be a really good choice. But really machine learning
https://www.houseofbots.com/news-detail/4685-1-best-books-and-sites-for-machine-learningUdemy -> free course
Introduction to PyTorch and Machine Learning | Udemy
Learn the basics of ML & PyTorch - Free Course
https://www.udemy.com/intro-to-pytorch-and-machine-learning/SoloLearn: Learn to Code - This is a website based working portal, where each next module is unlocked only if the current work is completed with a quiz or multiple choice question. - So one is forced to learn in a sequence
Join Now to learn the basics or advance your existing skills. Link: https://www.sololearn.com/
This website presents a series of lectures on quantitative economic modeling, designed and written by Thomas J. Sargent and John Stachurski.
Link: https://lectures.quantecon.org/py/Recommended Python learning resources:
https://forums.fast.ai/t/recommended-python-learning-resources/26888Unofficial Windows Binaries for Python Extension Packages.
MIT Machine Learning and Statistics -
https://ocw.mit.edu/courses/sloan-school-of-management/15-097-prediction-machine-learning-and-statistics-spring-2012/index.htmMIT Linear Algebra Course -
https://ocw.mit.edu/courses/mathematics/18-06-linear-algebra-spring-2010/video-lectures/If this has been useful, then consider giving your support by buying me a coffee
https://ko-fi.com/pythonprogrammerBook on Amazon Link: https://amzn.to/2ImYVhC
https://www.coursera.org/specializations/mathematics-machine-learning
In general if we do not use sns.set(), the background would be plain while displaying the graph.
For a better visual understanding we use sns.set().
https://seaborn.pydata.org/tutorial/aesthetics.htmlArtificial Intelligence - A Modern Approach - https://amzn.to/2Ip0Wdi (book)
An Introduction to Statistical Learning -
http://www-bcf.usc.edu/~gareth/ISL/Breast cancer classification with Keras and Deep Learning - PyImageSearch
https://codequs.com/p/BkaLEq8r4/a-complete-machine-learning-project-walk-through-in-python
https://www.pyimagesearch.com/2019/02/18/breast-cancer-classification-with-keras-and-deep-learning/
This website presents a series of lectures on quantitative economic modeling, designed and written by Thomas J. Sargent and John Stachurski.
https://forums.fast.ai/t/recommended-python-learning-resources/26888
Guys this might be helpful for future purpose. https://becominghuman.ai/cheat-sheets-for-ai-neural-networks-machine-learning-deep-learning-big-data-678c51b4b463
Anyone who want to open Jupyter notebook (.ipynb) file offline in PC, first you need Jupyter library file. You can get it by typing
pip install --upgrade pip
pip install jupyter
Or if you are using anaconda/Miniconda you don't need to install anything.
For remaining steps see this video
https://youtu.be/esKiryoBJBICheat Sheet of Machine Learning and Python (and Math) Cheat Sheets
If you like this article, check out another by Robbie: My Curated List of AI and Machine Learning Resources
https://in.udacity.com/course/ai-artificial-intelligence-nanodegree--nd898
Artificial Intelligence Course | UdacityLearn essentials of machine learning with from experts like Norvig and Sebastian
Demystifying Entropy
https://towardsdatascience.com/demystifying-entropy-f2c3221e2550The research paper is all about implementation of our project including extraction of text region..
https://www.researchgate.net/publication/311578437
_TextNon-text_Image_Classification_in_the_Wild_with_
Convolutional_Neural_Networks
In many cases, the information given below the video (under the show-more button is more useful than the video itself, so, please have a careful view for these contents as well.
- Kaggle i think so this will help u for sure https://www.youtube.com/watch?v=Gp_qv317Gew
- The following link seems to be good for a new comer to Python programming language
https://www.youtube.com/watch?v=RjMbCUpvIgw - Linear algebra
https://www.youtube.com/watch?v=ZK3O402wf1c&list=PL49CF3715CB9EF31D YouTubeHarvard University
https://www.youtube.com/watch?v=KbB0FjPg0mw&index=1&list=PL2SOU6wwx
Lecture 1: Probability and Counting | Statistics 110
B0uwwH80KTQ6ht66KWxbzTIo- Neural Networks:
https://www.youtube.com/watch?v=qv6UVOQ0F44 - Machine Learning: https://www.youtube.com/watch?v=UzxYlbK2c7E&list=PLA89DCFA6ADACE599
- https://www.youtube.com/watch?v=tGyfmzuR4d4
- Visualizing 4D Geometry - A Journey Into the 4th Dimension [Part 2]
- How Machines Learn
- PyTorch vs TensorFlow: The Force Is Strong With Which One? | Which One You Should Learn? | Edureka
- The incredible inventions of intuitive AI | Maurice Conti
- If anyone wants to go for python course along with data structures and algorithms:
https://onlinecourses.nptel.ac.in/noc19_cs08/unit?unit=22&lesson=25. - But what *is* a Neural Network? | Deep learning, chapter 1 - YouTube
https://youtu.be/aircAruvnKk?list=PLZHQObOWTQDNU6R1_67000Dx_ZCJB-3pi
In course of time, some of the links may not be functional...,
if you find any such links, please do let me know with correct adderss, so that the other person may have a valid link.
- https://www.sciencedirect.com/science/
- article/abs/pii/S0092656608000469
- https://www.independent.co.uk/life-style/how-to-spot-liar-lying-seven-tips-human-detector-darren-stanton-a7487351.html
- https://en.wikipedia.org/wiki/Lie_detection
- https://www.sciencedirect.com/science/article/
abs/pii/S0092656608000469 - https://www.nap.edu/read/10420/chapter/8#157
Data Visualization Society Launches
A new community for data visualization professionals has launched. It is called the Data Visualization Society.
https://101.datascience.community/2019/03/02/data-visualization-society-launches/- Analytics India Magazine
FB’s New Python Library Nevergrad Provides A Collection Of Algorithms That Don’t Require Gradient Computation
Nevergrad, an open-sourced Python3 toolkit by Facebook for developers offers an extensive collection of algorithms
https://www.analyticsindiamag.com/fbs-new-python-library-nevergrad-provides-a-collection-of-algorithms-that-dont-require-gradient-computation/ - TensorFlow Dev Summit 2019 Livestream
https://youtu.be/bDZ2q6OktQI - https://dms.licdn.com/playback/C5105AQGIvn6zJ3jAGQ/
519bdcda628946c4bb634188671d8e66/feedshare-mp4_500-captions-thumbnails/1507940118923-hysdc8?e=1551603600&v=beta&t=b7pjgrGrSFZGKg2M-Mmspds-zdneMOj5Y5nqCNV0Cq8
Module 1:
my publication on Medium website (as per course)
YouTube Publication:
Last Update Date: 17 Feb 2022
Number of bits
Question:
Consider a message A which can take on 16 values. The probabilities of each of these 16 values are 1/2, 1/4, 1/8, 1/16, 1/32, 1/64, 1/128, 1/128. You made an error in estimating these probabilities and came up with the following estimation for the 16 values: 1/128, 1/128, 1/64, 1/32, 1/16, 1/8, 1/4, 1/2 (in other words, you estimated highest probability for the least possible message and so on. What is the KL divergence between the true distribution and your estimated distribution (choose the closest rounded off number)?
Answer:
True Entropy
H1=-((1/2)*math.log2(1/2)+(1/4)*math.log2(1/4)+(1/8)*math.log2(1/8)+
(1/16)*math.log2(1/16)+(1/32)*math.log2(1/32)+
(1/64)*math.log2(1/64)+(1/128)*math.log2(1/128)+(1/128)*math.log2(1/128))
Cross Entropy
H2=-((1/2)*math.log2(1/128)+(1/4)*math.log2(1/128)+(1/8)*math.log2(1/64)+
(1/16)*math.log2(1/32)+(1/32)*math.log2(1/16)+(1/64)*math.log2(1/8)+
(1/128)*math.log2(1/4)+(1/128)*math.log2(1/2))
KL Divergence
H2-H1=4.5234(approx=4.5)
Number of bits
Question:
Consider the message A which can take on one of 8 values. The probability of each of these values is 1/2, 1/4, 1/8, 1/16, 1/32, 1/64, 1/128, 1/128. What is the ideal number of bits that you should use to transmit this message (choose the closest rounded off number)?
Answer:
Consider the distribution table below-
X IC(# Bits)
1/2 1
1/4 2
1/8 3
1/16 4
1/32 5
1/64 6
1/128 7
1/128 7
So,Ideal number of bits= Expected Number of bits=
1/2*1+ 1/4*2 + 1/8*3 + 1/16*4 + 1/32*5 + 1/64*6 + 1/128*7 + 1/128*7 = 1.98 (rounding off) -->2
Expectation:
Question:
Ramesh is supposed to report to office at 9 am every morning. In the past 30 days, he was ether late by 10 minutes or 15 minutes or he came 5 minutes before time or exactly on time. More specifically, he was on time on 4 days, late by 10 minutes on 10 days, late by 15 minutes on 5 days and 5 minutes before time on 11 days. What is the expected time at which he will reach office today ?
Answer:
Sir while explaining has actually missed dividing the # of occurrences ( in this example its 30 ) to find expectation.
9:00 AM x 4 days = 0 mins delay
9:10 AM x 10 days = 100 mins delay
9:15 AM x 5 days = 75 mins delay
8:55 AM x 11 days = - 55 mins delay
= 0 mins + 1000 mins + 75 mins late - 55 mins early
= 120 mins
Hence 120 mins /30 days = 4 mins / day
So 9:00 AM to 4 mins today hence 9:04 AM
Information Content
Question:
In the past 1024 days, the Cruciatus curse was used once at Hogwarts. Now consider a random variable X which will take on the value 1 if the Cruciatus curse is used and the value 0 if it is not used. What is the Information Content of the even X=1
Answer:
- log(P(x)) is the formula
P(x) = 1 / 1024
So, substituting P(x) in the formula,
-log(1/1024) = -log (1024 ^ -1) = - (-1) * log(1024) = log(2^10)
We know, log base 2 of 2 is 1, and log(m^n) = n log m
then, the ans is 10.
Entropy
Question:
Consider a discrete random variable which can take one of n possible values. State whether True or False: The entropy of this random variable is maximum when all the n values are equally likely.
Answer: 1:
If we put more probability mass into one event of a random variable, we will have to take away some from other events. This one will have less information content and more weight, the others more information content and less weight. Therefore the entropy being the expected information content will go down since the event with lower information content will be weighted more.
As an extreme case imagine one event getting a probability of almost one, therefore the other events will have a combined probability of almost zero and the entropy will be very low.
Answer: 2:
Think about it this way, if all events are equally probable, then you don't know which event is most likely to happen, hence entropy is maximum. If probability of one event is higher, then you can be more sure that this event is likely to happen. Entropy can be understood as the degree of confusion that you have about what will happen
If you find any useful links and can share,
please post them, here, I will, include to the above list.