Skip to main content


Showing posts from May, 2019

Building Human Centered AI with the Wolfram Neural Net Repository

The first phase of Modern AI is grinding to a halt. The PhDs have trained neural networks for doing all kinds of tasks for us. Everything from image recognition, audio synthesis, language modelling and translation already have some prebuilt deep neural net already in existence engineered from deep learning papers. Now it is time for the second phase of Modern AI development which involves using all these pre-built stuff as building blocks for Human Centered AI applications, that is applications that have AI as some submodule to perform some task.

What is Intelligence: The Wright Brothers

THE WRIGHT BROTHERS Every AI researcher should meditate on the invention of the aeroplane by the Wright brothers because what we intend to create is no different or less fundamental than mechanical powered flight. It is educative to watch the history of man’s attempt to replicate the flight of birds. The painful aspect of it is that non of the ingenious inventors including no one less than Leonardo DaVinci himself could foresee that the internal combustion engine was the single key to unleashing mechanical powered flight and not the attempt to replicate the flight of birds.

What is Intelligence: Evolution of Intelligence

EVOLUTION OF INTELLIGENCE Imagine a large laboratory where billions of beakers are holding different mixtures of elements and molecules prepared by some invisible agent or process. Some beakers explode some evaporate away, while some become sweet smelling some become very toxic, etc. now imagine that the agent/process just adds new elements and molecules to different beakers sometimes takes the content of one beaker and mixes it within another beaker or bunch of beakers.

What is Intelligence: Limitations of current neural networks

Limitations of current neural networks The biggest limitation of current neural networks is that they need enormous amounts of input data to properly generalize the data. To properly generalize data like images of dogs, cats or whatever we need millions to billions of instances of these data classes to train the network to be able to identify species of dogs or species of cats. It is clear that the human being requires very little input data to enable it to identify what is a dog and what is a cat, this is because it uses its imagination to generate all kinds of variations of the input data internally so it doesn't need so much input.

Announcing the FREE Wolfram Language Engine

The power of a programming language lies in the size and quality of the libraries available for it. When learning computer programming the student is exposed first of all to the syntax of the language which takes a great amount of time to come grips with for the newbie but can easily be grasped in a shorter period of time by the veteran.

What is intelligence: Search! The Algorithm of intelligence

Search! The Algorithm of intelligence I have previously talked about the network being the best representation for all kinds of problems and thus equivalent to what we can call general intelligence. My argument is that if we can find the most general representation of any problem whatsoever then we have discovered general intelligence because then it will be only a matter of manipulating the structure of this representation to solve any problem.

What is Intelligence: Human Brain vs. Artificial Neural Network Representation

 Human Brain vs. Artificial Neural Network Representation In regular programming, we usually write code in text form, but this code eventually gets transformed through several layers to a representation that the computer hardware can deal with, which are numbers. Basically just 1 and 0. But in reality, the computer doesn’t know what a number is and it is the humans who interpret the discrete states of the computer hardware as 1 and 0. There is no symbol 1 and 0 imprinted anywhere on the computer circuit, the computer circuit performs its operation on several circuit components that can be in any of the binary states of high or low voltages, it is the human who interprets these states as 1 and 0 thus ascribing a symbol to the lumped matter abstraction of computer circuitry.

What is Intelligence: Equivalence of different neural architectures

Equivalence of different neural architectures There are so many neural net architectures targeting one goal, for instance, you have VGG16, LeNet, ResNet, etc. All targeted at one goal, Image Identification. I have always puzzled about this, why is it that widely differing architectures are designed to achieve the same goal, i.e. image identification.

What is Intelligence: Learning in Humans

LEARNING IN HUMANS When humans are presented with information in their environment without a tag, this information could be about static stuff like trees, cats, cloud formations, etc. or it could be about dynamic processes like observing the seasons, the flight of birds, the swimming of fish or about other humans or entities performing some actions, the first thing the observing human mind does is to form an internal representation of whatever is being observed.

What is Intelligence: Neural Architecture Search

NEURAL ARCHITECTURE SEARCH In the early days of neural network research, human engineers were tasked with coming up with network architectures to achieve their goals. Nowadays there is some pioneering work on Neural architecture search where computers are used to search for useful networks that achieve better performance than architectures that were designed by human beings.

What is Intelligence: The Higher Magic of Pre-Built nets.

THE HIGHER MAGIC OF PRE-BUILT NETS We have reached a peak in terms of developing neural networks that solve basic kinds of problems. When a neural network is trained, which is usually a computationally expensive process that hugs huge amount of resources and can run for weeks, we obtain a set of weights which are the products of the training process.

Stephen Wolfram explains clearly how a Computational language differs from a Programming language

A 3D plot showing the positions of  Mars for the next 18 months from now: May 9th 2019 A computational language tries to intrinsically be able to talk about whatever one might think about in a computational way—while a programming language is set up to intrinsically talk only about things one can directly program a computer to do. So for example, a computational language can intrinsically talk about things in the real world—like the planet Mars or New York City or a chocolate chip cookie. A programming language can intrinsically talk only about abstract data structures in a computer.

What is Intelligence: Alien Intelligence

ALIEN INTELLIGENCE This work is about intelligence so it is necessary to contemplate what alien intelligence might be like even though we haven't encountered any till date. There are those that say humans are the only intelligent beings in the universe, but I think that is not correct and that the size of the universe in comparison with the size of the earth makes the possibility of conscious (using this word in the way it is understood regularly) beings might inhabit other worlds or places.

Learn Wolfram Mathematica in the cloud part 3

Most of the time in programming we don't just have single values to deal with because sometimes things come in a collection and we need something to hold them together. This is where lists come in.

What is Intelligence: Computational Equivalence

COMPUTATIONAL EQUIVALENCE ArrayPlot[ CellularAutomaton[<|"Dimension" -> 2, "GrowthCases" -> {3, 6}|>, {{Table[1, 5]}, 0}, {{{200}}}]] Almost all processes that are not obviously simple can be viewed as computations of equivalent sophistication (Wolfram 2002, pp. 5 and 716-717). As we talk of building intelligent machines one might stop to think about if it is even possible to build intelligent machines in the first place. There is a story from the history of mathematics and I will not go ahead to elaborate it in details but just call to mind the salient points and the lessons we can learn from that as we go ahead to try to build intelligent machines.

Learning Wolfram Mathematica in the Cloud Part 2

In the previous post, we got introduced to the symbolic nature of the Wolfram Language and also experimented with code live on the cloud. If you didn't see that post look for the post with the title above but without a part number on this blog. So let us get on with today's lesson.

Stephen Wolfram gives us a peek into the future: A world run with Code!

Computational languages vs. Programming Languages. Ubiquitous computational intelligence, The force of computation, computational contracts, and more. With a lifetime spent building one of the largest computational structures of our civilization, Wolfram Mathematica , Stephen Wolfram is highly qualified to give us hints as to where our technological civilization is taking us. See more by following the link:

What is Intelligence: Mind Space

MIND SPACE The physical human brain is just hardware for simulating what I call a mind space. If we borrow an analogy from computer architecture, we will see that the human brain is just basic hardware for implementing what we can call the machine architecture, which is built from the neurons and connections, and also with all other stuff going on like neurotransmitters etc.

Learning Wolfram Mathematica in the Cloud!

I am starting a mini blog series where I will teach you how to program in the Wolfram Language using the Wolfram cloud if you don't have a Mathematica desktop installation. Each blog post will contain a very short lesson that can be read in 5 minutes or less. I may sometimes include exercises which I encourage you to try out.

What is Intelligence: The AI Artist

Brooklyn Bridge Styled by THE AI ARTIST When AI researchers try to train a model to do art, for example, visual art in the form of painting, they train the model with all available images of artworks in order to produce new art. The art produced in this manner is of very low quality and despite the hype appears meaningless to many true artists. Does this mean that AI will never be able to do art? Not at all, AI will eventually be able to create true works of art, we just have to understand more of what goes on in the mind of the typical human being not just artists and we will be able to build systems that create art.

What is Intelligence: Beyond Images

BEYOND IMAGES So far we have been talking about Convolutional Neural Networks as applied to problems of image classification and I have mentioned recurrent neural networks (RNNs) in passing in previous chapters, but we must be wondering how humans learn information that is not static like images but sequential in nature. Information that may be spatially (in space) or temporally (in time) related?

What is Intelligence: Abstraction

ABSTRACTION The pattern recognition system of the human mind basically operates by the process of abstraction. In deep learning, we would call this feature extraction or generalization.

What is Intelligence: Representation

REPRESENTATION These days in AI research the word representation is being tossed around a lot, but it is important that we gain a deep understanding of what representation is as it is the key to understanding what the underlying intelligence of a human mind actually is.

The best language for data science

If I had not seen Wolfram language then I would have said: LISP is the best language to do data science. But thankfully Stephen Wolfram sought a general method of dealing with complicated integrals and built Wolfram language to do so. It turns out that this symbolic language called Wolfram language could  do more than math, after all, math is the lingua franca for science, which is our best method for describing the World and thus any language that enables you to do math in the most efficient way without adding too much "fat" would be the best language.

This powerful CEO works remotely, visits the office only a few times a year

To explain my personal infrastructure, I first have to say a bit about my daily life. Something that often surprises people is that for 28 years I’ve been a remote CEO. I’m about as hands-on a CEO as they come. But I’m only physically “in the office” a few times a year. Mostly I’m just at home, interacting with the company with great intensity—but purely through modern virtual means

What is Intelligence: A pass at creativity

A PASS AT CREATIVITY The human mind viewed in a certain way consists of a simple table lookup system that maps stored patterns to a menu of possible actions, and while many may frown at this simplistic view we must realize that it is by looking at the simplest possible model of things that we can really understand them. When we scrape away most of the details we can see the barebones implementation, understand them and then start adding sophistication.