project | ||
src | ||
.gitignore | ||
build.sbt | ||
HOCON.md | ||
LICENSE-2.0.txt | ||
README.md | ||
TODO.txt |
Configuration library for JVM languages.
Overview
- implemented in plain Java with no dependencies
- extensive test coverage
- supports files in three formats: Java properties, JSON, and a human-friendly JSON superset
- merges multiple files across all formats
- can load from files, URLs, or classpath
- good support for "nesting" (treat any subtree of the config the same as the whole config)
- users can override the config with Java system properties,
java -Dmyapp.foo.bar=10
- parses duration and size settings, "512k" or "10 seconds"
- converts types, so if you ask for a boolean and the value is the string "yes", or you ask for a float and the value is an int, it will figure it out.
- JSON superset features:
- comments
- includes
- substitutions (
"foo" : ${bar}
,"foo" : Hello ${who}
) - properties-like notation (
a.b=c
) - less noisy, more lenient syntax
- substitute environment variables and system properties
This library limits itself to config files. If you want to load config from a database or something, you would need to build a config object yourself and then merge it in.
License
The license is Apache 2.0, see LICENSE-2.0.txt.
Bugs and Patches
Report bugs to the GitHub issue tracker. Send patches as pull requests on GitHub.
Along with any pull requests (or other means of contributing), please state that the contribution is your original work (or that you have the authority to license it) and that you license the work under the Apache 2.0 license.
Whether or not you state this explicitly, by submitting any copyrighted material via pull request, email, or other means you agree to license your the material under the Apache 2.0 license and warrant that you have the legal authority to do so.
API Example
ConfigRoot root = Config.load("myapp")
int a = conf.getInt("foo.bar")
ConfigObject obj = conf.getObject("foo")
int b = obj.getInt("bar")
Standard behavior
You can load any files and merge them in any order, but the
convenience method Config.load()
loads the following
(first-listed are higher priority):
myapp.*
system propertiesmyapp.conf
(these files are all from classpath)myapp.json
myapp.properties
myapp-reference.conf
myapp-reference.json
myapp-reference.properties
JSON Superset
Tentatively called "Human-Optimized Config Object Notation" or
HOCON, also called .conf
, see HOCON.md in this directory for more
detail.
Features of HOCON
- Comments, with
#
or//
- Allow omitting the
{}
around a root object - Allow
=
as a synonym for:
- Allow omitting the
=
or:
before a{
sofoo { a : 42 }
- Allow omitting commas as long as there's a newline
- Allow trailing commas after last element in objects and arrays
- Allow unquoted strings for keys and values
- Unquoted keys can use dot-notation for nested objects,
foo.bar=42
meansfoo { bar : 42 }
- Duplicate keys are allowed; later values override earlier, except for object-valued keys where the two objects are merged recursively
include
feature merges root object in another file into current object, sofoo { include "bar.json" }
merges keys inbar.json
into the objectfoo
- include with no file extension includes any of
.conf
,.json
,.properties
- substitutions
foo : ${a.b}
sets keyfoo
to the same value as theb
field in thea
object - substitutions concatenate into unquoted strings,
foo : the quick ${colors.fox} jumped
- substitutions fall back to system properties and then
environment variables if they don't resolve in the
config itself, so
${HOME}
or${user.home}
would work as you expect.
Examples of HOCON
Start with valid JSON:
{
"foo" : {
"bar" : 10,
"baz" : 12
}
}
Drop root braces:
"foo" : {
"bar" : 10,
"baz" : 12
}
Drop quotes:
foo : {
bar : 10,
baz : 12
}
Use =
and omit it before {
:
foo {
bar = 10,
baz = 12
}
Remove commas:
foo {
bar = 10
baz = 12
}
Use dotted notation for unquoted keys:
foo.bar=10
foo.baz=12
Put the dotted-notation fields on a single line:
foo.bar=10, foo.baz=12
The syntax is well-defined (including handling of whitespace and escaping). But it handles many reasonable ways you might want to format the file.
Future Directions
Here are some features that might be nice to add.
- "Type consistency": if a later config file changes the type of a
value from its type in
myapp-reference.conf
then complain at parse time. Right now if you set the wrong type, it will only complain when the app tries to use the setting, not when the config file is loaded. - "myapp.d directory": allow parsing a directory. All
.json
,.properties
and.conf
files should be loaded in a deterministic order based on their filename. - some way to merge array and object types. One approach could
be:
searchPath=${searchPath} ["/usr/local/foo"]
, which involves two features: 1) substitutions referring to the key being assigned would have to look at that key's value later in the merge stack (rather than complaining about circularity); 2) objects and arrays would have to be merged if a series of them appear after a key, similar to how strings are concatenated already. A simpler but much more limited approach would add+=
as an alternative to:
/=
, where+=
would append an array value to the array's previous value. (Note that regular=
already merges object values, to avoid object merge you have to first set the object to a non-object such as null, then set a new object.) - "application.conf": normally there is no "global"
configuration, each application does its own
Config.load("myapp")
. However, it might be nice if you could put all your config for your app and libraries you use in a single file. This could be called "application.conf" for example.Config.load("myapp")
would load "application.conf" and merge in the"myapp"
object from "application.conf", so if "application.conf" contained:myapp { foo=3 }
then the keyfoo
would be set in the result ofConfig.load("myapp")
. Apps could then put all their config in "application.conf", if desired. - "delete": allow deleting a field, which is slightly different
from setting it to null (deletion allows fallback to values
in system properties and the environment, for example).
This could be done using the same syntax as
include
, potentially. It is not a backward-compatible change though.
Rationale
(For the curious.)
The three file formats each have advantages.
- Java
.properties
:- Java standard, built in to JVM
- Supported by many tools such as IDEs
- JSON:
- easy to generate programmatically
- well-defined and standard
- bad for human maintenance, with no way to write comments, and no mechanisms to avoid duplication of similar config sections
- HOCON/
.conf
:- nice for humans to read, type, and maintain, with more lenient syntax
- built-in tools to avoid cut-and-paste
- ways to refer to the system environment, such as system properties and environment variables
The idea would be to use JSON if you're writing a script to spit out config, and use HOCON if you're maintaining config by hand. If you're doing both, then mix the two.
Two alternatives to HOCON syntax could be:
- YAML is also a JSON superset and has a mechanism for adding
custom types, so the include statements in HOCON could become
a custom type tag like
!include
, and substitutions in HOCON could become a custom tag such as!subst
, for example. The result is somewhat clunky to write, but would have the same in-memory representation as the HOCON approach. - Put a syntax inside JSON strings, so you might write something
like
"$include" : "filename"
or allow"foo" : "${bar}"
. This is a way to tunnel new syntax through a JSON parser, but other than the implementation benefit (using a standard JSON parser), it doesn't really work. It's a bad syntax for human maintenance, and it's not valid JSON anymore because properly interpreting it requires treating some valid JSON strings as something other than plain strings. A better approach is to allow mixing true JSON files into the config but also support a nicer format.