M5_htm Computer Inspired by Hawkins Theories

Tech Center Labs has released an interesting piece of freeware for the Palm OS. Inspired by Jeff Hawkins book ON INTELLIGENCE and the work they are doing at Numenta, M5_htm Computer is an interactive simulation of memory prediction framework for Palm OS devices 3.5 and above.

The Input and Output environment is a 16 X 16 grid to make it easy to share data with a cluster of Palms. The software "learns" sequences of what is happening in its environment a step at a time, the present prediction grid was caused by the previous 'cause' grid (which was the prediction of a previous grid). M-5 can learn many memory sequences of various lengths and use a combination of them to interact with the environment.

m-5 htm palm softwareGary from TCL says, "M5 is the beginning of a very simplistic overview of what I gathered from On Intelligence. It is a pattern machine, it stores pattern sequences and recalls the patterns relevant to its present environment, there is very little invariance in M5 but its not desirable in this small simulation. I wanted it to have more exact memories of the environment so it would be useful to some degree. There is a simple hierarchy used to create the vectors but additional levels could use the predictions of M5 as their inputs to learn sequences of sequences while running the same simple code. The fact that a little 150k program can do what it is doing makes me think Jeff has it right and that NuPICs capability will be astounding!"

Article Comments


The following comments are owned by whoever posted them. PalmInfocenter is not responsible for them in any way.
Please Login or register here to add your comments.

Start a new Comment Down View Full Comment Thread

Bad links?

mikecane @ 4/27/2007 2:33:26 PM # Q
I can't get through to them.

RE: Bad links?
Ryan @ 4/27/2007 2:45:44 PM # Q
The links are working for me in firefox and ssfari. What is happening?
RE: Bad links?
mikecane @ 4/27/2007 2:57:36 PM # Q
OK, now they're working. Server must have been down or too busy. Weird.

Reply to this comment
RE: M5, huh?
Ryan @ 4/27/2007 3:04:54 PM # Q
Funny how there are three seperate TOS trek episodes where Kirk talks a computer to death. Landrew!
RE: M5, huh?
mikecane @ 4/27/2007 4:04:38 PM # Q
There's no voice input here, though. I guess I'll have to drop my CLIE and stomp it to death if it tries to take over! How's *that* for a very hard reset?

RE: M5, huh?
gmayhak @ 4/27/2007 4:26:23 PM # Q
Mike, just be sure to impress only nice engrams on it and you shouldn't have a problem ;-)

Tech Center Labs
RE: M5, huh?
mikecane @ 4/27/2007 5:02:19 PM # Q
That's what Daystrom thought *he* was doing!

Hmmmm... what engrams did TCL put in it?!!?

Why does it keep asking to predict my Social Security Number?! And why does it keep searching for a WiFi hotspot?


RE: M5, huh?
gmayhak @ 4/27/2007 6:20:11 PM # Q
The WiFi search was only supposed to happen in the wee hours, bummer :-(

I like your blog, good luck with the lotto

Tech Center Labs

RE: M5, huh?
freakout @ 4/27/2007 8:51:49 PM # Q
Funny how there are three seperate TOS trek episodes where Kirk talks a computer to death. Landrew!

I'm glad you find it funny. Most of us died after he shut off the computer that fed us...

- Keeper of Vaal

RE: M5, huh?
gmayhak @ 4/28/2007 9:59:10 PM # Q
OK Mike, I don't like your blog any more!
You were expecting Nostradamus to pop out of your antiquated Clie and give you some winning lotto numbers. You need to wait for Numenta's final version of NuPIC running on a grid of super computers.
In the mean time, I've heard that the 'strange attractors' theory works best in the dark, so you could try putting your list of past lotto numbers where the sun doesn't shine, get a good night's rest and maybe you'll wake up in the morning with the winning combination.
Let me know if it works ;-)


Tech Center Labs

RE: M5, huh?
mikecane @ 4/29/2007 12:43:55 PM # Q
Don't get all snarky on me. We've emailed each other and you pull this?

RE: M5, huh?
gmayhak @ 4/29/2007 2:45:34 PM # Q
You started it Mike, calling me a "You %@#! " and then, bashing my Hawkins Machine ;-)
Really, just my attempt at hummor after having a few beers last night.

Let me know how the M5_NN does, even a tiny bit above random could pay of in the long run.


Tech Center Labs

RE: M5, huh?
mikecane @ 4/29/2007 4:10:37 PM # Q
Blame it on beer.

M5htm predicted you'd do that!

RE: M5, huh?
gmayhak @ 4/29/2007 7:05:02 PM # Q
Pretty amazing! Notice how everyone is avoiding responding to the question near the end of the documentation ?

Tech Center Labs
RE: M5, huh?
mikecane @ 4/30/2007 12:00:00 PM # Q
What question? Obviously I've again missed something in my haste.

If M5_htm is a real indicator of Hawkins' theories, it's not a good augur. However, it does explain, in terms of neurological processing, how it is possible for something to "hide in plain sight." The brain expects what it has seen, not what it hasn't; its prediction -- expectation -- of reality overrides actual reality at times. Novelty is its downfall.

Still, I think Hawkins has something. I just don't know exactly what.

RE: M5, huh?
gmayhak @ 4/30/2007 12:43:41 PM # Q
This was the question...If we could teach a 2 year old to negotiate a maze and play tic tac toe we would say they were pretty intelligent. Could M-5 be showing a tiny spark of intelligence???
My real question is... At what point will a Numenta creation be considered an intelligent machine??? I think building intelligent machines is their goal but how is it defined?

Tech Center Labs
RE: M5, huh?
mikecane @ 5/1/2007 11:42:27 AM # Q
Oh, duh. My aneurysm was acting up again. I recall that now.

Since I'm not interested in those two examples, I'll refrain from otherwise commenting.

Reply to this comment

Now we shall see!!!

mikecane @ 4/27/2007 3:49:24 PM # Q
I've got historic data I've been dying to feed into a -- to coin a term! -- A Hawkins Machine.

Using this grid, it will be painful as hell, but I think I'm going to bust my ass this weekend and feed in a year's worth of historic data and see what comes out.

I've already inputted ~35 instances of historic data and gotten an interesting prediction.

*rubbing my hands in glee*

(How come that moneygrubber Gekko isn't jumping up and down at the possibilities?!!?)

RE: Now we shall see!!!
Gekko @ 4/27/2007 9:46:07 PM # Q
RE: Now we shall see!!!
SeldomVisitor @ 4/28/2007 6:07:14 AM # Q
> I've got historic data I've been dying to feed into a -- to coin
> a term! -- A Hawkins Machine...


A long long time ago in a different lifetime I had a brother in law, in Taiwan of all places, who was Big Time into playing the (Taiwan) lottery - he would stay up quite late every night STARTING at 2 AM (after closing his restaurants) to take the daily lottery numbers and attempt to find patterns between them and prior numbers. He also, not surprisingly, was Big Time into chewing betel nuts:

-- http://en.wikipedia.org/wiki/Betel_nut

One time while I was on vacation there he asked me to go with him to a computer show and help him buy a PC - I thought that was cool since this certainly would be the first computer in the entire family. The computer show was sorta like those held by Marketpro:

-- http://www.marketpro.com/

essentially displaying the wares of local and traveling PC stores, etc. He arranged with one of the displaying guys to go to the store after the show and buy a 286-based (I think) PC et al (for a couple thousand bucks, I think).

As we're leaving the show he asks me to write him a program to show frequency of occurrence of sets of 2, 3, 4, 5, and 6 numbers from the lottery drawings.

Before I left Taiwan for home.

In something like 2 days.

On a PC - something I'd never used before (I was a CP/M guy then moved on to an Amiga - never had used a MSFT PC at that time).


We go to the store to pick up the computer - I'm wondering what I'm going to do - write in Basic? - when I see a Turbo Pascal book on the shelf! Whoa! I've used Turbo Pascal on CP/M! (I think it was $25 when I used it - the reason I had it for CP/M - thanks, Borland!). I ask about it and THEN find out that the store will load any 5.25" floppy disks we buy with whatever software they have! I buy the book (in Chinese!) and a couple boxes of blank floppies and get a copy of PC-Turbo Pascal loaded for free.

Well, to make a long story longer, the Pascal environment on the PC was essentially the same as under CP/M (as was MS/DOS - no Windows then) so, using the illustrations in the book and my memory, on a PC with 64Kbytes of memory and a 5.25" floppy disk drive (only), I hacked out a simple sorting/counting algorithm with a user-friendly arrow-key-driven "curses"-like:

-- http://www.oreilly.com/catalog/curses/


Due to memory limitations, of course, "simple" wasn't really simple given the need to sort/count/display sets of as many as 6 numbers requiring more "bins" than integers on the computer!

He loved it.

I left Taiwan with a large chunk of cash - my very first "contract" job - and a happy in-law who, a few months later, credited the program with helping him select numbers for a fairly large win in the lottery! (No, it was purely random, of course, but HE thought so! Lol!)

So, good luck, Mike! It's doable!


RE: Now we shall see!!!
mikecane @ 4/28/2007 8:37:40 AM # Q
Gekko, if you would RMFB, you would have known that I know.

RE: Now we shall see!!!
rmhurdman @ 4/28/2007 9:14:56 AM # Q

That was a great tale, complete with betel nuts and computer market. It transported me to another time and place and the punchline was fantastic. Did you miss your calling in life?

RE: Now we shall see!!!
mikecane @ 4/28/2007 1:22:06 PM # Q
He ridicules such programs. Go Google. People buy them in fekkin droves. They even buy these ratty newsprint weeklies that use the "stars" and other crap to predict.

And come to NYC's Chinatown. They are gambling mad over there! OTB, scratch-offs, and draws. (There are also hidden gambling dens, of course.)

For your education, btw, go read The Eudamonic Pie and The Predictors:



OMG! Links that *aren't* to *my* blog!!

RE: Now we shall see!!!
SeldomVisitor @ 4/28/2007 5:50:49 PM # Q
> ...They even buy these ratty newsprint weeklies that use the "stars"
> and other crap to predict...

At the time (early 80s?) in Taiwan, the MAJOR money was in publishing those types of rags.

There even were pseudo-buddhist temples set up to help you with your number picking.

And, of course, said bro-in-law spent HOURS every night reading some of those rags and hand-computing scads of useless numbers to try to pick the winners. His "notes" were an amazing thing to behold - truly amazing - numerology at its finest!

[and folks sometimes wonder why I am SO against TA with stocks...giggle]

RE: Now we shall see!!!
mikecane @ 4/30/2007 11:55:20 AM # Q
>>>a few months later, credited the program with helping him select numbers for a fairly large win in the lottery! (No, it was purely random, of course, but HE thought so! Lol!)

Purely random? I doubt it.


For your education, btw, go read The Eudamonic Pie and The Predictors:



Additional: There are *many* Wall Street firms that use such systems on that lottery called the stock market. What, you *really* think they go by earnings, leadership, products, market share? Puhleeze! I've been there on the inside on such a project, and I've read about it too.

RE: Now we shall see!!!
SeldomVisitor @ 4/30/2007 11:58:59 AM # Q


RE: Now we shall see!!!
mikecane @ 4/30/2007 12:00:54 PM # Q
Giggle is not an answer. Stop being a snark and type real sentences. And go read those books too.

Reply to this comment


gmayhak @ 4/27/2007 6:47:55 PM # Q
I've uploaded version 1.1, it's more flexable classifing objects...
M5 version 1.1 uses invariant representation for position of an object on the grid, if you want it to treat the entire grid as an object turn on the top left pixel. It isn't able to use memos created with version 1.0 (sorry Mike ;)


Tech Center Labs

RE: upgrade
mikecane @ 4/28/2007 8:43:22 AM # Q
You %@#! I've already entered over 150 sets and you do this?!

I'll stick with this XP version until you make a case for moving to Vista!

RE: upgrade
mikecane @ 4/28/2007 8:46:58 AM # Q
Here, this should delay your upgrade madness:



RE: upgrade
SeldomVisitor @ 4/28/2007 5:53:23 PM # Q

That's even better numerology than lottery number picking or TA!

RE: upgrade
SeldomVisitor @ 4/28/2007 7:10:15 PM # Q
> ...complete with betel nuts and computer market...

It was interesting - a few hours after writing that I clickety-clicked on some of the sub-links at some of the pages I linked to in the original telling.

In particular, the Betel Nut Girl links! E.g.:

-- http://en.wikipedia.org/wiki/Betel_nut_beauty

-- http://www.youtube.com/watch?v=HJo7ZkLwkng&mode=related&search=

Talk about flashbacks! These sites are just totally right-on w.r.t. How It Was in Taiwan in the 80s (minimally). (the "barber shop pole" parlors were equally interesting...we won't get into that, however).

BTW - I tried a betel nut JUST once in many visits to Taiwan - bit hard onto it and had an AMAZING searing-flame pain crash against the back of my throat. I ended up chewing it down to the fibrous mass state but it was NOT a pleasant experience. To this day I do not know what that particular Betel Nut Beauty had put into that betel nut but I wouldn't be surprised to find out it was a Thai Pepper:

-- http://en.wikipedia.org/wiki/Thai_pepper

or something - rumors (and probably truths) suggested illegal amphetamines were often added to the nuts (cut a slit, insert goop) to generate extra kick (and addiction).

RE: upgrade
LiveFaith @ 4/28/2007 11:47:47 PM # Q
I've got it! This company should partner with Palm and pay the next Lotto Winning Genius another $1 million if he will just say publicly that he used this software (Palm OS exclusive) to calculate his winner.

Anyone eejit (credit Cane please) that is stupid enough to flush their hard earned $$$ down the toilet on lotteries and related fools games would jump at the opportunity. Two hundred bucks for a Palm handheld and $30 of software, for a step up on mega-millions. It's a no brainer. Before the foos got enough feedback to realize that they all can't win, these guys would have sold a 100 million units.

Pat Horne

RE: upgrade
mikecane @ 4/29/2007 12:46:04 PM # Q
You're too late. The market is saturated.

Reply to this comment

In all due respect to Jeff Hawkins...

VampireLestat @ 4/28/2007 5:59:42 PM # Q
I am against Numenta and AI development (for now).

Genius Hawkins is helping develop a science that taken to its extreme evolution, will create beings with a consciousness that will ultimately be able/want to enslave or destroy humanity.

Numenta may seem harmless, and we all love to embrace science, and chances are there is nothing going to stop AI development, but damn Hawkins to hell for helping to make it happen.

You guys can play with your first little Palm AI program (and I likely will as well - talk about a hypocritical irony), but let it be known that this is the beginning of the end (*dramatic music*).

I guess my point here is that Jeff Hawkins, philosophically, is guilty of involuntary crimes against humanity for conspiring (since AI has been worked on by others before him) to develop technology that mimics the human brain. [AND YES I'M NOT BEING 100% SERIOUS HERE! HAVE A SENSE OF HUMOR]. And there is no stopping this science now. Now comes the era in which we have to manage and control its development, same way we did/are doing with nukes.
Man o man, life is getting more complicated and risky everyday.

In the end, curiosity killed the cat.

Have fun with your little early stage Palm AI program!

RE: In all due respect to Jeff Hawkins...
Gekko @ 4/28/2007 7:09:33 PM # Q

we can only hope that they target canada first...


RE: In all due respect to Jeff Hawkins...
SeldomVisitor @ 4/28/2007 7:47:55 PM # Q
Rehashing well-traveled 30-year-old AI does not...you know...genius make.

Might sell well to naive Venture Capital though!


RE: In all due respect to Jeff Hawkins...
rsc1000 @ 4/28/2007 9:03:34 PM # Q
>>Rehashing well-traveled 30-year-old AI does not...you know...genius make.

Explain? Have you read 'On Intelligence'? I am not nesesarily disagreeing with you, but as Hawkins book is highly regarded by some heavy hitters in the AI field - and as he spends a considerable part of the book recapping the history of and thinking behind the field of AI - I assume that you have a detailed response. Whats your beef?

Seriously - let's hear it dude.

Reply to this comment
Start a New Comment Thread Top View Full Comment Thread
Achtung! Only the first 50 comments are displayed within the article.
    Click here for the full story discussion page...


Register Register | Login Log in