Category Archives: Uncategorized

Back to basics: Data Mining and Knowledge Discovery Process

Paras Doshi - Blog

Once in a while I go back to basics to revisit some of the fundamental technology concepts that I’ve learned over past few years. Today, I want to revisit Data Mining and Knowledge Discovery Process:

Here are the steps:

1) Raw Data

2) Data Pre processing (cleaning, sampling, transformation, integration etc)

3) Modeling (Building a Data Mining Model)

4) Testing the Model a.k.a assessing the Model

5) Knowledge Discovery

Here is the visualization:

knowledge discovery process data miningAdditional Note:

In the world of Data Mining and Knowledge discovery, we’re looking for a specific type of intelligence from the data which is Patterns. This is important because patterns tend to repeat and so if we find patterns from our data, we can predict/forecast that such things can happen in future.


In this blog post, we saw the Knowledge Discovery and Data Mining process.

View original post

Toying Around With Neural Networks

Dreaming Lucidly

Neural networks have been around in one form or another for millions of years.

Up until fairly recently (from 1940 onward) they were only implemented in wetware inside of various living organisms.  In recent decades it has become possible to implement neural networks on hardware and software to great effect in areas like speech recognition and computer vision.

There are many types of neural networks.  The feedforward neural network has been extensively studied and is often used to provide an introduction to the concepts underlying neural network technology.   The diagram below shows how an equation from introductory algebra can be interpreted as  a feedforward  neural network.

2-Layer NN Backprop Article Lin Eq Diagram

The feedforward neural network has “units” (the circles) that perform mathematical operations on the sum of outputs from connected units multiplied by the “weight” (the boxes) on the connection. The unit at the very end of the processing stream is the output unit which…

View original post 2,988 more words

Investigators Flooded With Tips After Missing Teen’s Parents Appear On Dr. Phil

CBS Denver

DURANGO, Colo. (CBS4)– Investigators in La Plata County have been flooded with tips from callers after the parents of missing teen Dylan Redwine appeared on Dr. Phil.

Dr. Phil interviewed Dylan’s parents, Mark and Elaine, on Tuesday afternoon’s show. Both parents blamed each other for Dylan’s disappearance.

On Wednesday, Dr. Phil interviews Dylan’s older brother, Cory. He won’t even call his father “Dad,” referring instead to him as “Mark.”
[worldnow id=8509213 width=420 height=278 type=video]

Cory also voices some suspicions.

“I think that Mark has something to do with it. I think he’s either got him hidden out or done something. I strongly think he’s involved,” said Cory. “He hasn’t done a single thing since Dylan has been gone.”

View original post

County Where Redwine Disappeared Continues To Devote Many Resources To Case

CBS Denver

DURANGO, Colo. (CBS4) – Since two episodes of the Dr. Phil show devoted to the disappearance of Dylan Redwine aired this week, the local tipline in La Plata County has received hundreds of calls.

Officials with the La Plata County Sheriff say most of them haven’t yet been checked into because of the sheer volume. But they said from the tips that have been sorted through, none of it has been very useful.

Even before the show, tips on Dylan’s possible whereabouts were still coming in regularly.

“I don’t think a day goes by where someone doesn’t call in and say ‘You know I was just thinking I saw this or talked to this person, or someone said they thought they saw someone,’ ” Sgt. Dan Bender told CBS4 recently.

[worldnow id=8510870 width=420 height=278 type=video]

Investigators say they have a wealth of evidence, but still no leads and no named…

View original post 207 more words

Sentiment Analysis using LingPipe on windows 7:

Paras Doshi - Blog

In this post, I’ll point you to the resource using which you can perform sentiment analysis using LingPipe on a windows OS. Along with that I’ll share couple of issues that I ran into when I was trying to run this demo on a Windows 7:

So first up, here’s the resource:

Now here are a couple of issues that I had:

1. Error: could not find or load the main class PolarityBasic

lingpipe could not find or load main class polaritybasic

To solve this error, you’ll need to build the files given under the C:\lingpipe-4.1.0\demos\tutorial\sentiment – we use ANT for this. Let’s see how to do that:

2. Building sentiment.jar using ant jar

After successfully downloading ant on windows and setting the ANT_HOME variable to c:\apache-ant-1.8.4 – I was still getting the error that ant is not a recognized command.

So I ran following commands:

C:\>set ANT_HOME=C:\apache-ant-1.8.1
C:\>set JAVA_HOME=C:\jdk1.6.0_24
C:\>set PATH=%ANT_HOME%\bin;%JAVA_HOME%\bin
C:\>ant -version
// it worked!


View original post 58 more words

How can we create Predictive Knowledge?

La Plata County Examples from the TRM-system

La Plata County Examples from the TRM-system

TRM-COVOR GIS System generated PDF (Beta)

CBS Denver

DURANGO, Colo. (CBS4) – The reward in the case of missing teenager Dylan Redwine has grown to more than $50,000.

Redwine was last seen at his father’s home near Durango the Sunday before Thanksgiving. His parents are divorced and the boy was there on a court ordered visit.

Police say they do not believe Redwine ran away. His mother says there will be rally in front of the father’s home Saturday to remind people Redwine is still missing.

View original post

CBS Denver

DURANGO, Colo. (AP/CBS4) – Investigators looking for a boy last seen in the Vallecito area on Nov. 19 say they hope to talk to a man seen in the north end of Vallecito that day.

La Plata County sheriff’s officials said Monday the man might not realize he could be a potential witness who could help find Dylan Redwine.

Investigators say they recently interviewed someone who remembered speaking to the man, who asked where to find gasoline for his vehicle Nov. 19.

[worldnow id=8354909 width=420 height=278 type=video]

“They’re still following up on tips that come in as they did over the weekend,” Dan Bender with the La Plata County Sheriff’s Office said. “It is frustrating, however, that we’re not getting any information that’s leading us to Dylan.”

The man said he was looking at rental properties. He is described as Hispanic, between ages 45 and 50, about 5-feet-10-inches tall, and…

View original post 96 more words

Dr. Phil Preview

%d bloggers like this: