Hadoop HDFS File Permissions
Apache Hadoop
| Intermediate
- 9 videos | 48m 34s
- Includes Assessment
- Earns a Badge
Explore reasons why not all users should have free reign over all data sets, when managing a data warehouse. In this 9-video Skillsoft Aspire course, learners explore how file permissions can be viewed and configured in HDFS (Hadoop File Management System) and how the NameNode UI is used to monitor and explore HDFS. For this course, you need a good understanding of Hadoop and HDFS, along with familiarity with the HDFS shells, and confidence in working with and manipulating files on HDFS, and exploring it from the command line. The course focuses on different ways to view permissions, which are linked to files and directories, and how these can be modified. Learners explore automating many tasks involving HDFS by simply scripting them, and to use HDFS NameNode UI to monitor the distributed file system, and explore its contents. Review distributed computing and big data. The closing exercise involves writing a command to be used on the HDFS dfs shell to count the number of files within a directory on HDFS, and to perform related tasks.
WHAT YOU WILL LEARN
-
Count the number of files and view their sizes on hdfs using the count and du commands
Configure and view permissions for individual files and directories using the getfacl and chmod commands
Define and set permissions for the entire contents of a directory with the chmod command
Write a simple bash script -
Automate the transfer of all the files in a directory on your local file system over the hdfs with a shell script
Identify the data and metrics available on the hdfs namenode ui and work with its file system explorer
Delete a google cloud dataproc cluster and all of its associated resources
work with file-permissioning in hdfs and recognize the data and metrics available in the namenode ui
IN THIS COURSE
-
2m 11s
-
7m 42sIn this video, you will count the number of files and view their sizes on HDFS using the count and du commands. FREE ACCESS
-
3. Viewing and Setting File Permissions in HDFS6m 54sIn this video, you will learn how to configure and view permissions for individual files and directories using the getfacl and chmod commands. FREE ACCESS
-
4. Applying Permissions Recursively in HDFS3m 52sIn this video, find out how to define and set permissions for the entire contents of a directory using the chmod command. FREE ACCESS
-
5. An Introduction to Bash Scripting7m 3sIn this video, you will learn how to write a simple bash script. FREE ACCESS
-
6. Scripting HDFS Operations7m 19sFind out how to automate the transfer of all the files in a directory on your local file system over the HDFS with a shell script. FREE ACCESS
-
7. Exploring the HDFS NameNode UI6m 20sIn this video, you will learn how to identify the data and metrics available on the HDFS NameNode UI and how to work with its file system explorer. FREE ACCESS
-
8. Cleanup Operations in HDFS1m 44sIn this video, learn how to delete a Google Cloud Dataproc cluster and all of its associated resources. FREE ACCESS
-
9. Exercise: File Permissions on HDFS5m 29sFind out how to work with file permissions in HDFS and recognize the data and metrics available in the NameNode UI. FREE ACCESS
EARN A DIGITAL BADGE WHEN YOU COMPLETE THIS COURSE
Skillsoft is providing you the opportunity to earn a digital badge upon successful completion on some of our courses, which can be shared on any social network or business platform.
Digital badges are yours to keep, forever.
