Error, "undefined symbol: lua_newuserdata" arise when I load luasql.postgres

[ytilimuh5306]

I need your help.

The OS is Rocky9, and installed postgresql-server, postgresql-server-devel

# cat /etc/rocky-release
Rocky Linux release 9.5 (Blue Onyx)

# dnf list --installed | grep postgresql
postgresql-server.x86_64                       13.20-1.el9_5                    @appstream               
postgresql-server-devel.x86_64                 13.20-1.el9_5                    @crb 

I built and installed Lua 5.2.4 from source.
I installed luasql-postgres with luarocks. But the error above is raised when I load it in the Lua script.
It's the same when I build it from the source

Here is the part of the code

# listener.lua
package.path = package.path .. ";/(source directory)/?.lua";
package.path = package.path .. ";/(source directory)/libs/?.lua";

local luasql = require "luasql.postgres"
~

The error message is below.

error loading module luasql.postgres from file /usr/local/lib/lua/5.2/luasql/postgres.so:
/usr/local/lib/lua/5.2/luasql/postgres.so: undefined symbol: lua_newuserdata
stack traceback:
    [C]: in ?
    [C]: in function require

I checked the dependencies of postgres.so, it seems that not all the symbols are exported from the Lua library.

[root@ik1-105-59335 luasql]# ldd -r /usr/lib/lua/5.2/luasql/postgres.so
        linux-vdso.so.1 (0x00007ffe1f52c000)
        libpq.so.private13-5 => /lib64/libpq.so.private13-5 (0x00007f953a319000)
        libc.so.6 => /lib64/libc.so.6 (0x00007f953a000000)
        libssl.so.3 => /lib64/libssl.so.3 (0x00007f953a233000)
        libcrypto.so.3 => /lib64/libcrypto.so.3 (0x00007f9539a00000)
        libgssapi_krb5.so.2 => /lib64/libgssapi_krb5.so.2 (0x00007f9539faa000)
        libldap.so.2 => /lib64/libldap.so.2 (0x00007f9539f43000)
        /lib64/ld-linux-x86-64.so.2 (0x00007f953a37e000)
        libz.so.1 => /lib64/libz.so.1 (0x00007f953a217000)
        libkrb5.so.3 => /lib64/libkrb5.so.3 (0x00007f9539926000)
        libk5crypto.so.3 => /lib64/libk5crypto.so.3 (0x00007f9539f2a000)
        libcom_err.so.2 => /lib64/libcom_err.so.2 (0x00007f953a210000)
        libkrb5support.so.0 => /lib64/libkrb5support.so.0 (0x00007f9539f19000)
        libkeyutils.so.1 => /lib64/libkeyutils.so.1 (0x00007f953a207000)
        libresolv.so.2 => /lib64/libresolv.so.2 (0x00007f9539912000)
        liblber.so.2 => /lib64/liblber.so.2 (0x00007f9539900000)
        libevent-2.1.so.7 => /lib64/libevent-2.1.so.7 (0x00007f95398a7000)
        libsasl2.so.3 => /lib64/libsasl2.so.3 (0x00007f9539887000)
        libselinux.so.1 => /lib64/libselinux.so.1 (0x00007f9539858000)
        libcrypt.so.2 => /lib64/libcrypt.so.2 (0x00007f953981e000)
        libpcre2-8.so.0 => /lib64/libpcre2-8.so.0 (0x00007f9539782000)
undefined symbol: lua_settop    (src/postgres.so)
undefined symbol: lua_toboolean (src/postgres.so)
undefined symbol: luaL_pushresultsize   (src/postgres.so)
undefined symbol: lua_touserdata        (src/postgres.so)
undefined symbol: luaL_setfuncs (src/postgres.so)
undefined symbol: luaL_argerror (src/postgres.so)
undefined symbol: lua_pushcclosure      (src/postgres.so)
undefined symbol: lua_tolstring (src/postgres.so)
undefined symbol: luaL_ref      (src/postgres.so)
undefined symbol: lua_createtable       (src/postgres.so)
undefined symbol: lua_rawset    (src/postgres.so)
undefined symbol: luaL_optlstring       (src/postgres.so)
undefined symbol: lua_rawgeti   (src/postgres.so)
undefined symbol: luaL_checklstring     (src/postgres.so)
undefined symbol: lua_pushvalue (src/postgres.so)
undefined symbol: lua_pushfstring       (src/postgres.so)
undefined symbol: lua_newuserdata       (src/postgres.so)
undefined symbol: lua_setmetatable      (src/postgres.so)
undefined symbol: lua_rawseti   (src/postgres.so)
undefined symbol: lua_pushnumber        (src/postgres.so)
undefined symbol: lua_settable  (src/postgres.so)
undefined symbol: lua_pushboolean       (src/postgres.so)
undefined symbol: luaL_checkstack       (src/postgres.so)
undefined symbol: luaL_buffinitsize     (src/postgres.so)
undefined symbol: luaL_checkudata       (src/postgres.so)
undefined symbol: lua_pushlstring       (src/postgres.so)
undefined symbol: luaL_error    (src/postgres.so)
undefined symbol: lua_isuserdata        (src/postgres.so)
undefined symbol: lua_pushnil   (src/postgres.so)
undefined symbol: lua_concat    (src/postgres.so)
undefined symbol: lua_type      (src/postgres.so)
undefined symbol: luaL_newmetatable     (src/postgres.so)
undefined symbol: luaL_unref    (src/postgres.so)
undefined symbol: lua_pushstring        (src/postgres.so)
undefined symbol: lua_getfield  (src/postgres.so)

I noticed after the installation that there was no liblua.so.
So, I built it as described in the #114

I copied liblua.so to /usr/lib64. also made the symbolic link /usr/lib64/liblua-5.2.so just in case, and reloaded ldconfig

# ls -la /usr/lib64/liblua*
lrwxrwxrwx 1 root root     20 May 14 12:12 /usr/lib64/liblua-5.2.so -> /usr/lib64/liblua.so
-rwxr-xr-x 1 root root 241336 May 14 12:08 /usr/lib64/liblua.so

# ldconfig -p | grep liblua
        liblua.so (libc6,x86-64) => /usr/local/lib/liblua.so
        liblua.so (libc6,x86-64) => /lib64/liblua.so
        liblua-5.2.so (libc6,x86-64) => /lib64/liblua-5.2.so

Again, I tried to install luasql-postgres using luarocks, and also built it from source.
But unfortunately the problem is still there and nothing has changed.

Could anyone share the idea for a solution?
Thanks!

[ytilimuh5306]

I will share the Makefile I used to build postgres.so.

./luasql/config

# Installation directories

# Default prefix
PREFIX ?= /usr/local

# Lua version and dirs
LUA_SYS_VER ?= 5.2
LUA_LIBDIR ?= $(PREFIX)/lib/lua/$(LUA_SYS_VER)
LUA_DIR ?= $(PREFIX)/share/lua/$(LUA_SYS_VER)
LUA_INC ?= $(PREFIX)/include

# OS dependent
UNAME_S := $(shell uname -s)
ifeq ($(UNAME_S),Darwin) # MacOS
	LIB_OPTION ?= -bundle -undefined dynamic_lookup -mmacosx-version-min=10.3
else # Linux/BSD
	LIB_OPTION ?= -shared
endif

# driver specific params
# - MySQL
#DRIVER_LIBS_mysql ?= -L/usr/local/mysql/lib -lmysqlclient -lz
#DRIVER_INCS_mysql ?= -I/usr/local/mysql/include
DRIVER_LIBS_mysql ?= -L/usr/lib64/mysql -lmysqlclient -lz
DRIVER_INCS_mysql ?= -I/usr/include/mysql
# - Oracle OCI8
DRIVER_LIBS_oci8 ?= -L/home/oracle/OraHome1/lib -lz -lclntsh
DRIVER_INCS_oci8 ?= -I/home/oracle/OraHome1/rdbms/demo \
                    -I/home/oracle/OraHome1/rdbms/public
# - PostgreSQL
#DRIVER_LIBS_postgres ?= -L/usr/local/pgsql/lib -lpq
#DRIVER_INCS_postgres ?= -I/usr/local/pgsql/include/
DRIVER_LIBS_postgres ?= -L/usr/lib64/pgsql -lpq
DRIVER_INCS_postgres ?= -I/usr/include/pgsql/
# - SQLite
DRIVER_LIBS_sqlite ?= -lsqlite
DRIVER_INCS_sqlite ?=
# - SQLite3 
DRIVER_LIBS_sqlite3 ?= -L/opt/local/lib -lsqlite3
DRIVER_INCS_sqlite3 ?= -I/opt/local/include
# - ODBC
DRIVER_LIBS_odbc ?= -L/usr/local/lib -lodbc
DRIVER_INCS_odbc ?= -DUNIXODBC -I/usr/local/include
# - Firebird
DRIVER_LIBS_firebird ?= -L/usr/local/firebird -lfbclient
DRIVER_INCS_firebird ?=

# general compilation parameters
WARN= $(OPTFLAGS) -Wmissing-prototypes -Wmissing-declarations -ansi -pedantic
INCS = -I$(LUA_INC)
DEFS = -std=gnu99 -fPIC -shared
CFLAGS=  $(WARN) $(DRIVER_INCS) $(INCS) -DLUASQL_VERSION_NUMBER='"$V"' $(DEFS)
CC= gcc

./luasql/Makefile

V= 2.7.0
CONFIG= ./config

include $(CONFIG)

OBJS= src/luasql.o
SRCS= src/luasql.h src/luasql.c

# list of all driver names
DRIVER_LIST= $(subst src/ls_,,$(basename $(wildcard src/ls_*.c)))

# used for help formatting
EMPTY=
SPACE= $(EMPTY) $(EMPTY)

all : 
	@echo "usage: make { $(subst $(SPACE),$(SPACE)|$(SPACE),$(DRIVER_LIST)) }"

# explicitly matches against the list of available driver names
$(DRIVER_LIST) : % : src/%.so

# builds the specified driver
src/%.so : src/ls_%.c $(OBJS) 
	$(CC) $(CFLAGS) src/ls_$*.c -o $@ $(LIB_OPTION) $(OBJS) $(DRIVER_INCS_$*) $(DRIVER_LIBS_$*)

# builds the general LuaSQL functions
$(OBJS) : $(SRCS)
	$(CC) $(CFLAGS) -c src/luasql.c -o src/luasql.o -L$(LUA_LIBDIR) -llua

install:
	mkdir -p $(LUA_LIBDIR)/luasql
	cp src/*.so $(LUA_LIBDIR)/luasql

jdbc_driver:
	cd src/jdbc; make $@

clean:
	rm -f src/*.so src/*.o

[alerque]

At a brief glance this sounds like you have more than one version of Lua and related headers available on your system, and a different version is getting found during the build process than at runtime.

[ytilimuh5306]

Hi, Alerque. Thanks for your reply.

After trying a few other ways, the error was somehow fixed.
I changed the Makefile as follows.

./luasql/Makefile

# builds the specified driver
src/%.so : src/ls_%.c $(OBJS) 
	$(CC) $(CFLAGS) src/ls_$*.c -o $@ $(LIB_OPTION) $(OBJS)  **-L$(LUA_LIBDIR) -llua-5.2** $(DRIVER_INCS_$*) $(DRIVER_LIBS_$*)

# builds the general LuaSQL functions
$(OBJS) : $(SRCS)
	$(CC) $(CFLAGS) -c src/luasql.c -o src/luasql.o

But another error appeared...

error loading module 'luasql.postgres' from file '/usr/lib64/liblua-5.2.so':
        /usr/lib64/liblua-5.2.so: undefined symbol: luaopen_luasql_postgres
stack traceback:
        [C]: in ?
        [C]: in function 'require'
        /listener.lua:19: in main chunk

Here are the referenced symbols in the so files.

# nm -D /usr/lib64/liblua-5.2.so | grep luaopen
000000000001e330 T luaopen_base
000000000001e8f0 T luaopen_bit32
000000000001eda0 T luaopen_coroutine
000000000001ffc0 T luaopen_debug
00000000000213a0 T luaopen_io
0000000000021da0 T luaopen_math
00000000000227a0 T luaopen_os
00000000000265b0 T luaopen_package
0000000000024b50 T luaopen_string
0000000000025680 T luaopen_table

# nm -D /usr/local/lib/lua/5.2/luasql/postgres.so | grep luaopen
0000000000003a3c T luaopen_luasql_postgres

As the error message mentions, the symbol is not present in liblua-5.2.so, but it is present in postgres.so.
Can you help me solve this?
Thanks

[tomasguisasola]

First, note that the original problem was due to lack of lua_newuserdata. This symbol should be at liblua.so or at the executable, provided that it was built properly to export its own symbols (which I think is the default, since Lua executable is linked against liblua.a). When loading the driver, it would need those symbols to access Lua's infrastructure.

Your last error says that there is no luaopen_luasql_postgres inside liblua, which shows that you changed at the wrong place.

I think you have to check if your executable (which is running your listener.lua script) was compiled exporting its symbols or if it is loading liblua-5.2.so...