- read files(csv/xlsx/dat) from ftp folders
- write into postgresql tables
- compare both tables and transform to new table
Data Format Example:
1=a,2=b,3=c,4=d
2=x,4=y
2=m
Table Column:
2
-------------------------
b
x
m
in the above data(each row, we need to read only 2 value and write into table). this is only dummy data, actually it is huge file