Get File Names from FTP Server and Save to SQL Server Table in SSIS Package by using Script Task - SQL Server Integration Services (SSIS) Tutorial

Scenario: 

We have different files on FTP Server, we want to get the names of all the files from FTP Server folder and save to our SQL Server Table for Audit Purpose. By doing that multiple times we can get the snapshot of all the files available on FTP Server Folder.

This can be very useful when we are looking for some total files to be there before we start process etc.

we will learn following items in this video

1. How to Create an SSIS Package from basics
2. How to create FTP Connection in SSIS Package
3. How to Create ADO.Net Connection in SSIS Package to Connect to Database
4. How to Create variable for FTP Folder Name and pass to Script Task
5. Write Script by using VB.Net in Script Task to Get the List of Files from a Remote FTP Folder and insert the file names to SQL Server Table.
6. How to change the value of Variable to loop through different folder to extract file name without make any other change in our SSIS Package

Create SQL Server Table to Save File Names from FTP Server Folder

USE Test
go
CreateTable dbo.FTPFileList
(ID intidentity(1,1),
FolderName VARCHAR(100),
FileName VARCHAR(200),
LoadDate datetime default getdate())

 

Script Task Part

In this Import Part , you have to add below line

Imports System.Data.SqlClient

In Main Sub paste the below script

Dim StrFolderArrary AsString()
Dim StrFileArray AsString()
Dim fileName AsString
Dim RemotePath AsString

        RemotePath = Dts.Variables("User::RemoteFolder").Value.ToString()

Dim ADODBConnection As SqlClient.SqlConnection
        ADODBConnection = DirectCast(Dts.Connections("DBConnection").AcquireConnection

(Dts.Transaction), SqlClient.SqlConnection)
Dim cm As ConnectionManager = Dts.Connections("FTP_Connection") 'FTP connection manager name
Dim ftp As FtpClientConnection = New FtpClientConnection(cm.AcquireConnection(Nothing))

        ftp.Connect() 'Connecting to FTP Server

        ftp.SetWorkingDirectory(RemotePath) 'Provide the Directory on which you are working on FTP Server
        ftp.GetListing(StrFolderArrary, StrFileArray) 'Get all the files and Folders List

'If there is no file in the folder, strFile Arry will contain nothing, so close the connection.
If StrFileArray IsNothingThen
            ftp.Close()

'If Files are there, Loop through the StrFileArray arrary and insert into table
Else
ForEach fileName In StrFileArray
'MessageBox.Show(fileName)
Dim SQLCommandText AsString
                SQLCommandText = "Insert into dbo.FTPFileList (FolderName,FileName) 

values ('" + RemotePath + "','" + fileName + "')"
'MessageBox.Show(SQLCommandText)
Dim cmdDatabase As SqlCommand = New SqlCommand(SQLCommandText,ADODBConnection)

                cmdDatabase.ExecuteNonQuery()
Next
            ftp.Close()
EndIf