The compatibility implementation of lua_stringtonumber uses strtod internally by default, so it depends on the quality of your C library whether hexadecimal number literals are supported. If you are unsatisfied with your strtod implementation, you can provide your own using the the semi-official macro lua_str2number(s, p) from luaconf.h.