Snigdhajyoti Ghosh snigdhasjg

Keybase proof

I hereby claim:

I am snigdhasjg on github.
I am discotoma2 (https://keybase.io/discotoma2) on keybase.
I have a public key ASDnDXioUZiAyPk8rlNxG1t6Gxx-JscFUtLeyO7BTcQ8BQo

To claim this, I am signing this object:

Getting started with EMRFS

The EMR File System (EMRFS) is an implementation of HDFS that all Amazon EMR clusters use for reading and writing regular files from Amazon EMR directly to Amazon S3.

How to access a file from S3 using EMRFS

Using Java

Coming from HDFS it is very easy to implement EMRFS. You just need to pass URI("s3://<bucket-name>") object while getting filesystem object.

package com.joe;

	# Use the official Ubuntu image as the base image
	FROM ubuntu:22.04

	# Install OpenSSH server
	RUN apt update && apt install -y openssh-server git

	# Create an app user with git-shell
	RUN useradd -ms /bin/bash -s $(which git-shell) git

	# Switch as git user

	# ~/.gitconfig

	# Note:
	# [Windows users] If you are on windows, please search for the word 'windows' - and fix those lines - they seem to cause some trouble
	# [General] Since some of the settings are specific to my setup (ie presence of fles), I have marked those lines with comments 'Personal' - you can go ahead and change those to your equivalents or delete them altogether
	# [General] Since I use 'diff-so-fancy' as the diffing tool, it's absence on your system will cause some errors. If you are able to, I would sincerely urge you to install and use it for a much better experience. If not, please replace all such occurrences back to use 'diff'

	# Note: Even though this will show up twice in `git config -l` - it will still be overridden based on the order of the includeIf lines below
	[user]
	email = [email protected]

	openapi: 3.0.3
	info:
	title: Unit of measure
	description: Gives ratio
	version: "0.0.1"
	servers:
	- url: 'https://uom.com/v1'
	tags:
	- name: UOM
	description: Unit of measure