AUTOMATING SECURE DATA TRANSFERS TO SFTP
OVERVIEW
A leading nonprofit needed to securely deliver Account, Contact, Opportunity, and Payment data from Salesforce to a partner system on a weekly basis. Since Salesforce doesn’t natively support direct SFTP uploads, Fiduciary Tech designed an AWS-powered integration to bridge the gap. This automated system reduced manual intervention, ensured compliance, and provided a reliable way to transfer both updated and complete datasets.
THE CHALLENGE
The client required a secure, repeatable way to send Salesforce data to a partner SFTP server. Salesforce lacks a straightforward mechanism for direct SFTP uploads, and manual processes introduced risks of error, delay, and compliance issues. They also wanted admins—not developers—to be able to adjust job frequency and configuration without code changes. The goal was to build a fully automated, low-maintenance solution that could handle both scheduled weekly transfers and ad-hoc complete file uploads.
OUR SOLUTION
We implemented a hybrid Salesforce–AWS integration. A scheduled Apex job in Salesforce generates CSVs and pushes them into an S3 bucket via a named credential for AWS authentication. The system is configured to identify and extract only records that have changed since the previous weekly run, ensuring efficient, timely updates. An AWS Lambda function—using the pysftp Python module for secure file transfer—is triggered by S3 events to pick up the files, authenticate with the partner SFTP via Secrets Manager, and deliver the data. After confirmation, the Lambda function deletes the files from S3 to maintain security.
To maximize flexibility, Salesforce Custom Settings were used so admins could adjust filter values, notification emails, and job frequency without code changes. This design empowers business users, reduces reliance on IT, and ensures the integration can adapt as requirements evolve.
KEY FEATURES
- • Weekly automated file transfer of only updated records
• On-demand complete file uploads triggered from Salesforce
• AWS Lambda with pysftp for secure SFTP interface
• Admin-controlled configuration for job frequency and filters via Custom Settings
• Error and info notifications automatically sent from Salesforce
• End-to-end file lifecycle management, including secure cleanup
GLOBAL IMPACT/RESULTS
- • Eliminated manual file handling, reducing operational overhead
• Transferred only updated data each week, improving efficiency and reducing file size
• Increased reliability of data transfers, ensuring partner trust
• Improved compliance with secure, encrypted, and auditable processes
• Scalable, low-maintenance design that empowers admins and supports future integrations
TECHNOLOGIES & SERVICES
Salesforce Scheduled Job — Automates weekly execution
Apex (Scheduler & Batch Classes) — Data extraction and CSV generation
Salesforce Custom Settings — Admin control of filters, email addresses, and job frequency
Salesforce Named Credential — Secure AWS authentication
AWS S3 — File staging and event notification
AWS Lambda — Event-driven processing and SFTP delivery
pysftp Python Module — SFTP file transfer
AWS Secrets Manager — Secure storage of API keys
IAM Roles & Policies — Granular access control
CONCLUSION
By combining Salesforce with AWS services, Fiduciary Tech delivered a secure, automated data pipeline that eliminated manual work and reduced integration risk. The nonprofit can now reliably provide their partner system with up-to-date information, while maintaining compliance and preparing for scalable, future integrations. The use of admin-controlled configurations ensures the solution is not only automated, but also flexible and low-maintenance for long-term success.