Blog Post: Hadoop HDFS maximum number of files

Blog Post: Hadoop HDFS maximum number of files

This post was originally published on this site

Just a short blog about HDFS directory file and memory limits. I’ve recently faced an issue with Hive with the following error message The parameter which caused the error above is called dfs.namenode.fs-limits.max-directory-items dfs.namenode.fs-limits.max-directory-items 1048576 Defines the maximum number of items that a directory may contain. The parameter controls how much in a directory on […]


Schreibe einen Kommentar

Deine E-Mail-Adresse wird nicht veröffentlicht. Erforderliche Felder sind mit * markiert.