Search for a command to run...
Enhance Data Efficiency: Seamlessly Integrate SFTP User Access with S3, SQS, and VM Directory Mounting for Streamlined File Management
Devops | 3x AWS Certified | CKA
No comments yet. Be the first to comment.
Introduction If you are moving to AWS Identity Center (formerly SSO) and want to keep your Google Workspace users and groups in sync, ssosync is the go-to tool. However, setting up the permissions can be tricky. If you’ve seen the error unauthorized_...
Introduction In this tutorial, I will guide you through establishing a SAML connection between Google Workspace and AWS Identity Center. Later, you will synchronize users from Google Workspace using SCIM. To verify that everything is configured corre...
Implementing Gang Scheduling for Distributed GPU Training on Amazon EKS
Quick Solution If you're in a hurry to solve deployment time issues, simply add the WEBSITE_RUN_FROM_PACKAGE environment variable to your Azure Web App settings and set its value to 1. This change can significantly reduce your deployment times. W...
General DevOps logic behind jiocinema
Create s3 bucket.
Create sqs queue.
create ec2 instance (ubuntu)
create IAM User for accessing s3 bucket and add s3 permission to it.
Install s3fs
sudo apt update
sudo apt install s3fs
Setup creds for s3fs
Create file
sudo vim /etc/passwd-s3fs
# write below content with its actual value for iam user created
ACCESS_KEY_ID:SECRET_KEY_ID
create user for sftp
#!/bin/bash
# Usage: sudo ./create-sftp-user.sh username
USERNAME=$1
S3_BUCKET_NAME="s3-bucket-name"
S3_BUCKET_PATH="$S3_BUCKET_NAME:/incoming/$USERNAME"
MOUNT_DIR="/mnt/sftp-s3/$USERNAME"
sudo useradd -m -d "$MOUNT_DIR" -s /bin/bash -G sftponly "$USERNAME"
# Set password for the user
sudo passwd "$USERNAME"
sudo s3fs "$S3_BUCKET_PATH" "$MOUNT_DIR" -o passwd_file=/etc/passwd-s3fs -o allow_other -o nonempty
sudo mkdir -p "$MOUNT_DIR/data"
sudo s3fs "$S3_BUCKET_PATH" "$MOUNT_DIR/data" -o passwd_file=/etc/passwd-s3fs -o allow_other -o nonempty
echo "User $USERNAME added and configured."
sudo vim /etc/ssh/sshd_config
at last write
Match User userName
ChrootDirectory /mnt/sftp-s3/$USERNAME
ForceCommand internal-sftp
AllowTcpForwarding no
X11Forwarding no
PasswordAuthentication yes
now try to access over sftp .
{
"Version": "2012-10-17",
"Id": "Policy1679925546977",
"Statement": [
{
"Sid": "Stmt1679925532180",
"Effect": "Allow",
"Principal": "*",
"Action": "sqs:*",
"Resource": "arn:aws:sqs:region:1111111111:sqs_name",
"Condition": {
"ArnEquals": {
"aws:SourceArn": "arn:aws:s3:::s3-buket-name"
}
}
}
]
}
Create s3 event notification.
Thanks
For more such content follow me on :
Twitter : https://x.com/akash202k_