I assume it was the browser cache that was getting me. Tried it just now at work and it is there
Thank you for the help and for removing my pic. I will study it to figure out what was insecure about it - for my learning.
New questions will be coming, but this one is resolved.
For anyone looking this thread over in the future - Favicon works by simply putting the favicon.ico in the store root folder. The code is already present in the store to use it
I would like to mark this as resolved, but not sure how..