Working with Files in Hadoop HDFS
Apache Hadoop
| Beginner
- 8 videos | 47m 17s
- Includes Assessment
- Earns a Badge
In this Skillsoft Aspire course, learners will encounter basic Hadoop file system operations such as viewing the contents of directories and creating new ones. This 8-video course assumes good understanding of what Hadoop is, and how HDFS enables processing of big data in parallel by distributing large data sets across a cluster; learners should also be familiar with running commands from the Linux shell, with some fluency in basic Linux file system commands. Begin by working with files in various ways, including transferring files between a local file system and HDFS (Hadoop Distributed File System) and explore ways to create and delete files on HDFS. Then examine different ways to modify files on HDFS. After exploring the distributed computing concept, prepare to begin working with HDFS in a production setting. In the closing exercise, write a command to create a directory/data/products/files on HDFS, for which data/products may not exist; list two commands for two copy operations-one from local file system to HDFS, and another for reverse transfer, from HDFS to local host.
WHAT YOU WILL LEARN
-
Identify the different ways to use the ls and mkdir commands to explore and create directories on hdfs
Transfer files from your local file system to hdfs using the copyfromlocal command
Copy files from your local file system to hdfs using the put command
Transfer files from hdfs to your local file system using the copytolocal command -
Use the get and getmerge functions to retrieve one or multiple files from hdfs
Work with the appendtofile and rm commands on the hdfs dfs shell
Utilize hdfs commands to work with and manipulate files using the hdfs shell
IN THIS COURSE
-
2m 13s
-
9m 8sIn this video, you will learn how to identify the different ways to use the ls and mkdir commands to explore and create directories on the Hadoop Distributed File System. FREE ACCESS
-
3. Using the copyFromLocal Command in HDFS6m 47sIn this video, learn how to transfer files from your local file system to HDFS using the copyFromLocal command. FREE ACCESS
-
4. Using the put Command in HDFS4mIn this video, learn how to copy files from your local file system to HDFS using the put command. FREE ACCESS
-
5. Using the copyToLocal Command in HDFS4m 57sIn this video, you will learn how to transfer files from your local file system to HDFS using the copyFromLocal command. FREE ACCESS
-
6. Retrieving files from HDFS6m 29sDuring this video, you will learn how to use the get and getmerge functions to retrieve one or multiple files from HDFS. FREE ACCESS
-
7. Append and Delete Operations in HDFS8m 58sIn this video, you will learn how to work with the appendToFile and rm commands on the hdfs dfs shell. FREE ACCESS
-
8. Exercise: Working with Files on HDFS4m 45sIn this video, you will learn how to use HDFS commands to work with and manipulate files using the HDFS shell. FREE ACCESS
EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE
Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.
Digital badges are yours to keep, forever.
