arrows function but after pressing 'i' , one is not able to use backspace.
That is the default setting even when nocompatible is set. Our policy is to use Vim's default configuration and only deviate where truly necessary. In this case you should add "set backspace=2" to your personal .vimrc if you wish to change the default behavior.