![]() | ||
Besides complexity intended as a difficulty to compute a function (see computational complexity), in modern computer science and in statistics another complexity index of a function stands for denoting its information content, in turn affecting the difficulty of learning the function from examples. Complexity indices in this sense characterize the entire class of functions to which the one we are interested in belongs. Focusing on Boolean functions, the detail of a class
Contents
- Definition of sentry function
- Definition of detail
- Example continuous spaces
- Example discrete spaces
- References
To identify this index we must first define a sentry function of
- the sentry points are external to the concept c to be sentineled and internal to at least one other including it,
- each concept
c ′ c ′ c ′ c ′ - they constitute a minimal set with these properties.
The technical definition coming from (Apolloni 2006) is rooted in the inclusion of an augmented concept
Definition of sentry function
For a concept class
- Sentinels are outside the sentineled concept (
c ∩ S ( c ) = ∅ for allc ∈ C ). - Sentinels are inside the invading concept (Having introduced the sets
c + = c ∪ S ( c ) , an invading conceptc ′ ∈ C is such thatc ′ ⊈ c andc + ⊆ ( c ′ ) + u p ( c ) the set of concepts invading c, we must have that ifc 2 ∈ u p ( c 1 ) , thenc 2 ∩ S ( c 1 ) ≠ ∅ ). -
S ( c ) is a minimal set with the above properties (NoS ′ ≠ S exists satisfying (1) and (2) and having the property thatS ′ ( c ) ⊆ S ( c ) for everyc ∈ C ). - Sentinels are honest guardians. It may be that
c ⊆ ( c ′ ) + S ( c ) ∩ c ′ = ∅ so thatc ′ ∉ u p ( c ) . This however must be a consequence of the fact that all points ofS ( c ) are involved in really sentineling c against other concepts inu p ( c ) and not just in avoiding inclusion ofc + ( c ′ ) + c ′ , S ( c ) remains unchanged (Wheneverc 1 c 2 c 1 ⊂ c 2 ∪ S ( c 2 ) andc 2 ∩ S ( c 1 ) = ∅ , then the restriction ofS to{ c 1 } ∪ u p ( c 1 ) − { c 2 } is a sentry function on this set).
With reference to the picture on the right,
Definition of detail
The frontier size of the most expensive concept to be sentineled with the least efficient sentineling function, i.e. the quantity
is called detail of
The detail
See also Rademacher complexity for a recently introduced class complexity index.
Example: continuous spaces
Class C of circles in
Example: discrete spaces
The class
This class has