Posts

IoT-World of Opportunities

Image
The Internet of things is the new and vast field of opportunities in today’s era. In this digital world the most important thing is data and this is the only platform every one need to work. Without this, nothing would be possible in digital world. As the use of technology and its advancement increase the quantity of data automatically. According to the predictions of data scientists tremendous amount of data will be increased in near future. To maintain and extract the important information from this data automation of these processes is required. According to various agencies like data fabric trends report, by the end of 2025 data automation market will be reached to $4.2 billion. So Iot is the one area for data collection and its automation. In the upcoming future working and job opportunities in this field is the hottest platform for the youth.  Figure 1: IoT Infrastructure and Technologies IoT platform provide the various services for the ease of life, business improvement, re...

Machine Learning (ML)

Image
  Machine Learning (ML) Machine learning is a branch of AI, used to process and analyse the data using various algorithms that mimics the learning behaviour of humans for analysing the data. These algorithms predict the outcomes without intervention of human. It provides the systems that automatically learn and improve based on their experience.  Fig 1 depicts the process of machine learning. It consists of five steps starting with collection of data and ends at model deployment. These are 5 basic steps: Collection of Data from various data source Data cleaning and Feature Engineering Model building and Selection of ML Algorithm Model Evaluation Model Deployment Fig. 1 Basic Process of Machine Learning Generally, Data collection is the key process in ML. Based on the addressed problem, we have to obtain the data from different sources. Data can be collected from social media, public opinion poll, or survey of the product success or failure.  Next step in ML is data cleani...

Data Science with Spark

Image
  DATA SCIENCE AND APACHE SPARK Data Science has transformed the world. It has contributed towards the excessive growth of data and to develop intelligent systems. To analyze large amounts of data, various Data Science tools are available to Data Scientists. Among several available tools, Apache Spark has revolutionized the Data Science industry in a great manner. Apache Spark Spark is one of the open-source which is capable to process huge amount of data efficiently with very high speed. Due to its data streaming capability, Spark has left behind the other existing Big Data platforms. It also carry out machine learning operations and SQL workloads that allow us to access the datasets. Spark is developed on application levels through multiple languages like Python, Java, R, and Scala. Components of Apache Spark for Data Science Main components of Spark are – Spark Core, Spark SQL, Spark Streaming, Spark MLlib, Spark R and Spark GraphX. SNo Components Description 1 Spark Core This i...

Hack-o-Problem

From this month we are starting a post “Hacko-problem” related to hackathon problems. This initiative will help and ignite spark in the minds of young people as to what are real world problems and what are the ways or approaches to solve a problem. Hope to find tangible solutions to the problems and activate hidden talent of problem solving inside the youth of today. For the problems one needs to submit their solutions in a document with the whole plan, or could create a video explaining the solution. We have attached a Google Form for the submission of the solution. Problem Build an online system for monitoring water quality, leaks, contamination, and managing pipeline network. Design simulation of the hardware that would provide the solution. Organization Andhra Pradesh Innovation Society, ITE&C Department Dataset Source NEERI Dataset Year of study 2005 Cities covered 1. Allahabad  2. Bangalore  3. Bhopal 4. Bhubaneshwar  5. Chandigarh  6. Coimbatore 7. Dehradu...

DOCUMENTATION ON LINEAR REGRESSION

Image
Linear Regression Linear Regression is the simplest algorithm . Linear Regression is basically modelled using a straight line . It is used with continous variable to predict values .  It is illustrated by the equation :       y= a0+a1x+ ε   This equation tells us the relationship b/w the two variables i.e x and  y.  y depends on the value of x . and where,a0 is the intercept ,a1 is Linear regression coefficient and ε = random error. Types Positive  and Negative Linear Relationship: In Positive linear relationship, if y increases then x increases.  In Negative linear relationship, if y decreases then x decreases. Our main aim in this regression is to find the best fitted line . So, basically there are three common evolution metrics to find that : Mean Absolute Error Mean Squared Error Root Mean Squared Error Linear regression is furture categorized  into two types of the algorithm: Simple Linear Regression: If only one variable(...

Ubuntu on Windows

Image
This tutorial is for all those viewers who have Windows operating system and want to install Ubuntu in their system. This tutorial will explain the following points:- How to install Virtual Machine( Virtualbox ) in your system?   How to install Linux ( Ubuntu ) in your virtual machine Let's start the process. 1.      Download the Virtualbox software from virtualbox.org . VirtualBox Website 2.      After download, install the software by double-clicking the installer. 3.      Now download Ubuntu ISO Image from https://ubuntu.com/download/desktop . Ubuntu Website 4.      After installation of VirtualBox now let us create a virtual machine so that we can install Linux on it. For Linux users, all the further steps are the same. Click on the New icon in the toolbox. 5.      Type Ubuntu in Name and click next. 6.      Set memory size as 512 MB. 7. ...