Extended packaged code metadata support

[pombredanne]

This feature is about collecting and returning extended metadata available from package manifests such as license, name, version etc from RPMs, NPMs, Gems, Jars, etc.

[pombredanne]

This is a very simple start with a new --package_details option, for now only available in the JSON output:

      "package_details": [
        {
          "type": "npm", 
          "packaging": null, 
          "primary_language": "JavaScript", 
          "metafile_location": "tst/node_modules/morgan/package.json", 
          "id": "morgan", 
          "name": "morgan", 
          "qualified_name": "npm morgan", 
          "version": "1.5.1", 
          "summary": "HTTP request logger middleware for node.js", 
          "asserted_licenses": [
            {
              "license": "MIT", 
              "text": null, 
              "notice": null, 
              "url": null
            }
          ], 
          "author": [], 
          "author_email": [], 
          "author_url": [], 
          "homepage_url": "https://github.com/expressjs/morgan", 
          "download_url": "http://registry.npmjs.org/morgan/-/morgan-1.5.1.tgz", 
          "vcs_tool": "git", 
          "vcs_repository": "https://github.com/expressjs/morgan"
        }

[pombredanne]

In #242 @rakeshbalusa wrote:

ake the example of the module pyrpm (URL - https://github.com/nexB/scancode-toolkit/tree/develop/src/packagedcode/pyrpm) in Packagedcode which can detect an RPM file in a given codebase. It is a good idea to have a recognize function in each and every subclass of the Package class which can detect the corresponding packages.
Hierarchy of the Package types must be strictly maintained. For example, Bower packages are a type of NPM packages and the corresponding BowerPackage must be a subclass of NpmPackage but not the Package class itself.
A working scenario :
Each and every file in a given codebase must be passed to the recognize functions of all the Package subclasses and if any recognize function returns true then the file must be processed depending on the subclass whose method returned true.

[pombredanne]

This is taken care for the supported packages. There are dedicated bugs where need such as #649. Closing this