After little bit of 'googling',I could successfully connect to my ODBC
1.)Exec sp_addlinkedserver
EXEC sp_addlinkedserver
@server = 'MY_ODBC_SERVER',
@srvproduct = '',
@provider = 'MSDASQL',
@datasrc = 'QFTest' //System DSN
GO
2.)To check whether SP worked,
EXEC sp_tables_ex @table_server = 'MY_ODBC_SERVER'
3.)I could successfully retrieve all the data from the table 'BTL'
SELECT * FROM OPENQUERY(MY_ODBC_SERVER, 'SELECT * FROM BTL')