The recognition of images beyond basic image processing often relies on training an adaptive system using a set of samples from a desired type of images. The adaptive algorithm used in this research is a learning automata model called CLS (collective learning systems). Using CLS, we propose a hierarchy of collective learning layers to learn color and texture feature patterns of images to perform three basic tasks: recognition, classification and segmentation. The higher levels in the hierarchy perform recognition, while the lower levels perform image segmentation. At the various levels the hierarchy is able to classify images according to learned patterns. In order to test the approach we use three examples of images: a) Satellite images of celestial planets, b) FFT spectral images of audio signals and c) family pictures for human skin recognition. By studying the multi-dimensional histogram of the selected images at each level we are able to determine the appropriate set of color and texture features to be used as input to a hierarchy of adaptive CLS to perform recognition and segmentation. Using the system in the proposed hierarchical manner, we obtained promising results that compare favorably with other AI approaches such as Neural Networks or Genetic Algorithms.