You will however by very limited in what you can do.
You will for instance not be able to do such things as dig, mine, create, repair or improve items , or use alchemy.
You will also not be able to steal, pick locks or destroy structures to mention just a few other limitations.