Thursday, January 7, 2010

android property system

Property system is an important feature on android. It runs as a service and manages system configurations and status. All these configurations and status are properties. A property is a key/value pair, both of which are of string type.
From the sense of function, it's very similar to windows registry. Many android applications and libraries directly or indirectly relies on this feature to determine their runtime behavior. For example, adbd process queries property service to check if it's running in emulator. Another example is the java.io.File.pathSeparator returns the value stored in property service.

How property system works
The high level architecture of property system is shown as following.
android prop sys arch
In the figure, there are three processes, a group of persistent property files and a shared memory block. The shared memory block is the container of all property records. Only the property service process can write to the shared memory block. It'll load property records from persistent the save them in the shared memory.
The consumer process loads the shared memory in its own virtual space and access properties directly. The setter process also loads the shared memory in its virtual space, but it can't write to the memory directly. When the setter tries to add or update a property, it sends the property to property service via unix domain socket. The property service will write the property to shared memory on behalf of the setter process, as well as to the persistent file.

Property service runs inside init process. The init process first creates a shared memory region and stores a fd to the region. Then init process maps the region into its virtual space with mmap with MAP_SHARED flag, as a result, any updates to this area can be seen by all processes. This fd and region size are saved in a environment variable named "ANDROID_PROPERTY_WORKSPACE". Any other processes like consumer and setter will use this environment variable to get the fd and size, so that they can mmap this region into its own virtual space. The layout of the shared memory is shown below.
androi prop mem layout
After that, init process will load properties from following files:
/default.prop
/system/build.prop
/system/default.prop
/data/local.prop


The next step is start property service. In this step, a unix domain socket server is created. This socket's pathname is "/dev/socket/property_service" which is well known to other client processes.
Finally, init process calls poll to wait for connect event on the socket.

On the consumer side, when it initializes libc(bionic/libc/bionic/libc_common.c __libc_init_common function). It will retrieve the fd and size from environment variable, and map the shared memory into its own space(bionic/libc/bionic/system_properties.c __system_properties_init function). After that, libcutils can read property just as normal memory for the consumer.

Currently, properties can't be removed. That's to say, once a property has been added, it can't be removed, neither can its key be changed.

How to get/set properties

There are three main means to get/set properies on android.

1. native code
When writing native applications, property_get and property_set APIs can be used to get/set properties. To use them, we need to include cutils/properties.h and link against libcutils.

2. java code
Android also provides System.getProperty and System.setProperty functions in java library, our java application can use them to get/set properties.
But it's important to note that although these java APIs are semantically equal to native version, java version store data in a totally different place. Actually, a hashtable is employed by dalvik VM to store properties. So, java properties are separated, it can't get or set native properties, and neither vice versa.

Update: Andrew mentioned that android.os.SystemProperties class can manipulate native properties, though it's intended for internal usage only. It calls through jni into native property library to get/set properties.

3. shell script
Android provides getprop and setprop command line tool to retrieve and update properties. They can be used in shell script. They are implemented on top of libcutils.

19 comments:

Anonymous said...

Thanks, for a very good explaination of android properties!!

andrewboie said...

You can get/set native properties in Java, although the API is undocumented. See android.os.SystemProperties

Any Java application can read system properties, but (if I remember correctly) you have to be running as the system server UID to set them.

rxwen said...

andrew,

Thanks for your complementary information.
I didn't notice that internal java class can manipulate native properties.

Tony said...

Very good article. Am I right that the property system is not synchronous - so if I set a property and the read it immediately afterwards (or if another process read it immediately afterwards) then I might get the old value? If so, is there a blocking way to read or write properties?

rxwen said...

The read and write operations to properties are guaranteed to be atomic through futex on android.
So, if the read operation really occurs (be scheduled) after the write operation, the consumer won't get the old value.
If you want to serialize the read and write operation as specific order in your own application, you need to use appropriate thread synchronization mechanisms.

rosie said...

Great detailed information, I ll be visiting you more frequently, here is very interesting information.
Thanks for sharing with us ...



public records

Anonymous said...

Very informative, great explanation of get and set. Is there anything like notify....Is there any way for native app to be notified of a specific property change....

rxwen said...

I didn't see android property system support notification.
If it's a desired feature, you may implement your own notification. For example, the reader waits on a mutex until the writer notifies the mutex.

suchi said...

Hi All,
I am tryinng to update some system property using native API property_set through JNI.But the result is not getting updated .
Do i need to run my application using system server UID .If so, how it is done?

guru said...

Hi andrew,

I am facing issue with setting system properties. when I issue setprop x 10 and then cross check with getprop x it is not displaying 10. otherway it is not setting system property.

What may be the reason for this? is it problem with shared memory size?

rxwen said...

I'm not sure if andrew will come back to my blog and answer your question. So I'll try if I can help you.
I tested your command, it worked fine on my android virtual device. I was able to get x's value after it was set with setprop command.

Did you see any error message?
Did you modify/add any properties before issue "setprop x 10" ? On my android 2.2 virtual device, there are 132 existing properties. What about yours?

guru said...

Hi rxwen,

I got some clue regarding this. If I try to comment some other system properties, then I can set the value. Is there any specific requirements to set/get system property. Does it depend on memory allocated to store system properties?

Thanks
Gururaja B O

rxwen said...

What's the total number of properties on your system?
As you can see in the second diagram, there are 247 property slots available. If all slots are occupied, then new property can't be added.

guru said...

Hi rxwen,

If I count total number of properties from getprop command it is showing 246.

is this count 247 is fixed or can we increase it?

Thanks
Gururaja B O

rxwen said...

The max slots is defined as PA_COUNT_MAX in system\core\init\property_service.c.
You may change its value to a greater one.
But are you sure you need to store so much items as properties?
Why not consider other alternatives if property service isn't designed to store so much items?

guru said...

Hi rxwen,

Thanks for the information. I increased the PA_COUNT_MAX and other macros. Now it is setting the system properties.

I dont know why so many system properties, since I can not delete them only way now is increasing the shared memory area.

Thanks
Gururaja

lorry said...

Hi thanks for the information but I am stuck up with the same error java unsatisfied link error while using this method in android.os.system properties.
How do I resolve it?
public static void set(String key, String val) {
....
native_set(key, val); // error here
}

rxwen said...

hi lorry,

It seems the error is caused by not being able to find the native cutils lib for jni.
can you elaborate how do you make use of the systemproperties class?

mafj said...

Can you set a property using a kernel command line parameter?