What is the difference between a BarChart and a Histogram ?

A Histogram represents the distribution of a numerical variable.  A bar-chart is typically used to compare numeric values corresponding to categorical variables. To construct a histogram:  X-axis: Usually the range of values is binned. In other words, the entire range is divided into a series of intervals and each interval occupies a slot on the…

Learn Data Science and Machine Learning from Scratch

The task of transitioning to a new field is challenging ! not for the faint hearted… It is not very different from climbing a mountain ! To become a data scientist you need to learn Some math (Stats, linear algebra, optimization) Programming (preferably Python / R) The art of working with and analyzing data But…

What is the difference between a Histogram and a Pareto plot ?

A histogram is a bar graph that uses the height of the bar to convey the  frequency of an event occurring. Each bar in a histogram corresponds  to the frequency of occurrence of a specific event. A Pareto chart displays bars by the height of the bars, signifying the order of impact. It follows the Pareto philosophy (the 80/20 rule) through…

What is ACID property in a database? For data analytics tasks, do you need to care about ACID properties ?

ACID properties are important in an RDBMS setting where operations are transnational and there are database updates involved as a part of the task. For instance a banking or an e-commerce application where real-time user data is updated typically needs an RDBMS. A data analyst typically handles structured data using query languages such as SQL. However,…

What are the different types of Joins while wrangling data?

Here are the different types of the JOINs in SQL: (INNER) JOIN: Returns records that have matching values in both tables LEFT (OUTER) JOIN: Returns ALL records from the left table, and the matched records from the right table RIGHT (OUTER) JOIN: Returns ALL records from the right table, and the matched records from the…

Name a few problems that data analysts typically encounter?

Some of the problems encountered by a data analyst are :  Biased Data : Data could be biased due to the source from which it is collected. For instance, suppose you collect data to determine the winner of an electoral campaign, collecting from a specific region alone introduces one form of a bias, while collecting…

When are deep learning algorithms more appropriate compared to traditional machine learning algorithms?

Deep learning algorithms are capable of learning arbitrarily complex non-linear functions by using a deep enough and a wide enough network with the appropriate non-linear activation function. Traditional ML algorithms often require feature engineering of finding the subset of meaningful features to use. Deep learning algorithms often avoid the need for the feature engineering step….

Why do you typically see overflow and underflow when implementing an ML algorithms ?

A common pre-processing step is to normalize/rescale inputs so that they are not too high or low. However, even on normalized inputs, overflows and underflows can occur: Underflow: Joint probability distribution often involves multiplying small individual probabilities. Many probabilistic algorithms involve multiplying probabilities of individual data points that leads to underflow. Example : Suppose you…

How do you manage not to get overwhelmed by data?

It is important to get comfortable dealing with data as a data scientist. One might have done a PhD and have learnt many statistical techniques. HOWEVER: Given a problem,  first try to think how you can solve the problem – Data Science or no data science. Try to spend time visualizing data in  a different…