Name: mpmd
Owner: AOE
Description: Magento Project Mess Detector (for n98-magerun)
Created: 2014-11-27 04:40:52.0
Updated: 2017-11-21 21:05:42.0
Pushed: 2017-09-12 07:42:36.0
Homepage: null
Size: 2375
Language: PHP
GitHub Committers
| User | Most Recent Commit | # Commits |
|---|
Other Committers
| User | Most Recent Commit | # Commits |
|---|
Author: Fabrizio Branca (fbrnc.net / @fbrnc)
Some additional commands for the excellent n98-magerun Magento command-line tool that will help you find out how messed up a Magento instance is :)
magerun.phar | grep mpmd
d:codepooloverrides Find all code pool overrides
d:corehacks Find all core hacks
d:dependencycheck Find dependencies
d:dependencycheck:configured Returns the list of modules that are CONFIGURED in these module's config xml.
d:dependencycheck:graph:class Creates a class graph
d:dependencycheck:graph:configured Creates a graph of all configured depencencies.
d:dependencycheck:graph:module Creates a module graph
d:dependencycheck:verify Checks if found dependencies match a given module's xml file
There are a few options. You can check out the different options in the MageRun docs.
Here's the easiest:
Install n98-magerun if you haven't already. Find the instructions on the n98-magerun wiki.
Create ~/.n98-magerun/modules/ if it doesn't already exist. (or /usr/local/share/n98-magerun/modules or put your modules inside your Magento instance in lib/n98-magerun/modules if you prefer that)
r -p ~/.n98-magerun/modules/
Clone the mpmd repository in there.
clone https://github.com/AOEpeople/mpmd.git ~/.n98-magerun/modules/mpmd
It should be installed. To verify that it was installed correctly, check if the new commands show up in the command list:
magerun.phar | grep mpmd
mpmd:corehackse:
d:corehacks [--format[="..."]] pathToVanillaCore [htmlReportOutputPath] [skipDirectories]
ments:
hToVanillaCore Path to Vanilla Core used for comparison
lReportOutputPath Path to where the HTML report will be written
pDirectories ':'-separated list of directories that will not be considered (defaults to '.svn:.git')
This command requires a vanilla version of Magento (same version and edition! Run n98-magerun.phar sys:info for more details) to be present somewhere in the filesystem.
It will then traverse all project files and compare them with the original files.
This command will also be able to tell the difference between whitespace or code comments changes and real code changes.
It will generate a HTML report that also includes the diffs.
/var/www/magento/htdocs
8-magerun.phar mpmd:corehacks /path/to/vanilla/magento /path/to/report.html
aring project files in 'var/www/magento/htdocs' to vanilla Magento code in '/path/to/vanilla/magento'...
-------------------+-------+
pe | Count |
-------------------+-------+
fferentFileContent | 2 |
enticalFiles | 16049 |
leMissingInB | 1 |
meFileButComments | 0 |
-------------------+-------+
rating detailed HTML Report
Report preview:
mpmd:codepooloverridese:
d:codepooloverrides [--format[="..."]] [htmlReportOutputPath] [skipDirectories]
ments:
lReportOutputPath Path to where the HTML report will be written
pDirectories ':'-separated list of directories that will not be considered (defaults to '.svn:.git')
This command will compare all code pools with each other and detect files that are overriding each other. It will show identical files (What's the point of these? But yes, seen projects where this happened), copied files with changes in comments and whitespace only, and real changes. Of course with diff…
Report preview:
The dependency checker parses one or more files or directories and detects PHP classes that are being “used” there.
The dependency checker is a “semi” static code analysis tool. That means it does the job without actually executing any of the PHP code you're pointing it to, but it does need that module to be installed correctly and it will invoke the Magento framework to resolve classpaths (catalog/product -> Mage_Catalog_Model_Product)
While tools like pdepend exist those tools don't know anything about Magento in general, Magento's special classpaths and where they are being used. Also sometimes the numbers generated by pdepend are a little overwhelming and after all what are you going to do knowing that you're module has an avarage cyclomatic complexity of x?
The mpmd:dependencychecker will
The dependency checker comes with two different parsers (and allows you to add new ones:)
| Parser | Will process | How it works |
|———–|—————-|—————————————————————————————————————————————————–|
| Tokenizer | *.php, *.phtml | The tokenizer parser will split the PHP file into tokens and traverses them. Handlers can subscribe to token to detect various class usages. |
| Xpath | *.xml | The xpath parser will read the file into a SimpleXMLElement object and will pass this to all the subscribed handlers |
Add a new parser via n98-magerun's YAML configuration
ands:
md\Magento\DependencyCheckCommand:
parsers:
- Mpmd\DependencyChecker\Parser\Tokenizer
- Mpmd\DependencyChecker\Parser\Xpath
- (... add your parser here ...)
All parsers need to implement Mpmd\DependencyChecker\Parser\ParserInterface. Also checkout the AbstractParser that implements that interface and might be a good starting point.
Every parser comes with a number of handlers. Here's the list of default handlers that come with the dependency checker:
| Parser | Handler | Will process | What it does |
|———–|———————–|———————————-|——————————————————————————————————|
| Tokenizer | Interfaces | T_IMPLEMENTS | Finds interfaces: class A implements B {} |
| Tokenizer | WhitespaceString | T_NEW, T_EXTENDS, T_CLASS | Finds classes instantiated with 'new': $a = new B();
Finds extended classes: class A extends B {} |
| Tokenizer | StaticCalls | T_DOUBLE_COLON | Finds static calls: A::B and A::B() |
| Tokenizer | TypeHints | T_FUNCTION | Finds type hints: function a (B $b) {} |
| Tokenizer | MagentoFactoryMethods | T_STRING for specific keywords | Finds classes instantiated with one of Magento's factory methods and resolves them to real PHP classes not taking rewrites into account:Mage::getModel()Mage::getSingleton()Mage::getResourceModel()Mage::getResourceSingleton()$this->getLayout()->createBlock()Mage::getBlockSingleton()Mage::helper()Mage::getResourceHelper()Mage::getControllerInstance()
|
| Xpath | LayoutXml | All xml files | Finds blocks and resolves them into real PHP classes: <block type="core/text"> |
| Xpath | SystemXml | All xml files | Finds references to models in system.xml files:<frontend_model>adminhtml/system_config_form_field_notification</frontend_model><source_model>adminhtml/system_config_source_yesno</source_model><backend_model>adminhtml/system_config_backend_store</backend_model> |
Note: MagentoFactoryMethods, LayoutXml and SystemXml need to resolve Magento classpaths into real PHP classes. The challenge hereby is NOT to take rewrites into account since rewriting a class is a mechanism that was introduced to ALLOW decoupling without dependending on each other. In order to leverage Magento and it's configuration to resolve the class paths but not take the rewrite into accounts
Mage_Core_Model_Config having access to the same data but doing things slightly differently. Mpmd\Util\MagentoFactory takes care of that and provides access to some of the original functions like getModelClassName() and getBlockClassName()…Add a new handler via n98-magerun's YAML configuration (also checkout n98-magerun's documentation for custom commands)
ands:
md\Magento\DependencyCheckCommand:
Mpmd\DependencyChecker\Parser\Tokenizer:
handlers:
- Mpmd\DependencyChecker\Parser\Tokenizer\Handler\WhitespaceString
- Mpmd\DependencyChecker\Parser\Tokenizer\Handler\Interfaces
- (... add your tokenizer handler here ...)
<Parser>:
handlers:
- (... add your <parser> handler here ...)
All handlers need to implement Mpmd\DependencyChecker\HandlerInterface. Also checkout the AbstractHandler and the inheriting abstract handlers for the tokenizer parser and the xpath parser that implement that interface and might be a good starting point.
Almost every command (and sub-command) of the dependency checker requires you to specify what you want to analyze. This can be one or more files or directories. And glob patterns are also supported. Here are some examples:
ngle file:
8-magerun.phar mpmd:dependencycheck -m app/code/local/My/Module/Model/Test.php
ll directory:
8-magerun.phar mpmd:dependencycheck -m app/code/local/My/Module/
ll modman directory (will also find the files you might have in app/design/):
8-magerun.phar mpmd:dependencycheck -m .modman/My_Module
ob patterns are supported:
8-magerun.phar mpmd:dependencycheck -m app/code/local/My/*/
8-magerun.phar mpmd:dependencycheck -m app/code/local/*/*/
8-magerun.phar mpmd:dependencycheck -m app/code/*/*/*/
ltiple locations
8-magerun.phar mpmd:dependencycheck -m app/code/local/My/Module/ app/code/community/My/OtherModule/ app/design/frontend/mypackage
Note: Please specify absolute paths or paths relative to your Magento root directory (not relative to the current directory, which might be different if n98-magerun detected Magento in a different directory (e.g. htdocs/) or you're using --root-dir=... to tell n98-magerun where to find your Magento root)
mpmd:dependencycheckerThis is the main command that gives you access to following options (specify one or more):
| Option | Short option | What it does |
|—————|————–|——————————————————————————————————————————|
| --modules | -m | This shows you all modules that were detected in the specified sources and the modules that this code depends on. |
| --libraries | -l | This shows you all the libraries (lib/*) that the specified sources depend on |
| --classes | -c | This detects all the classes in the specified sources (where available) and shows what other classes they are using and how. |
| --details | -d | This shows all the details (verbose!) |
-m|--modules8-magerun.phar mpmd:dependencycheck -m app/code/core/Mage/Captcha
------------+----------------+
urce Module | Target Module |
------------+----------------+
ge_Captcha | Mage_Core |
ge_Captcha | Mage_Admin |
ge_Captcha | Mage_Customer |
ge_Captcha | Mage_Checkout |
ge_Captcha | Mage_Adminhtml |
------------+----------------+
-l|--libraries8-magerun.phar mpmd:dependencycheck -l app/code/core/Mage/Captcha
--------+
braries |
--------+
rien |
nd |
--------+
-c|--classes8-magerun.phar mpmd:dependencycheck -c app/code/core/Mage/Captcha
---------------------------------------+-----------------------------------------+--------------------------+
urce class | Target Class | Access Types |
---------------------------------------+-----------------------------------------+--------------------------+
ge_Captcha_Block_Captcha | Mage_Core_Block_Template | extends |
ge_Captcha_Block_Captcha | Mage_Captcha_Helper_Data | helper |
ge_Captcha_Block_Captcha_Zend | Mage_Core_Block_Template | extends |
ge_Captcha_Block_Captcha_Zend | Mage_Captcha_Helper_Data | helper |
ge_Captcha_Model_Config_Form_Backend | Mage_Captcha_Model_Config_Form_Abstract | extends |
ge_Captcha_Model_Config_Form_Abstract | Mage_Core_Model_Config_Data | extends |
ge_Captcha_Model_Config_Form_Frontend | Mage_Captcha_Model_Config_Form_Abstract | extends |
-d|--details8-magerun.phar mpmd:dependencycheck -d app/code/core/Mage/Captcha
---------------------------------------------------------------------+------------------+-------------------------------------------------+
le | Access Type | Class |
---------------------------------------------------------------------+------------------+-------------------------------------------------+
p/code/core/Mage/Captcha/Block/Captcha.php | class | Mage_Captcha_Block_Captcha |
p/code/core/Mage/Captcha/Block/Captcha.php | extends | Mage_Core_Block_Template |
p/code/core/Mage/Captcha/Block/Captcha.php | helper | Mage_Captcha_Helper_Data |
p/code/core/Mage/Captcha/Block/Captcha/Zend.php | class | Mage_Captcha_Block_Captcha_Zend |
p/code/core/Mage/Captcha/Block/Captcha/Zend.php | extends | Mage_Core_Block_Template |
p/code/core/Mage/Captcha/Block/Captcha/Zend.php | helper | Mage_Captcha_Helper_Data |
p/code/core/Mage/Captcha/etc/system.xml | source_model | Mage_Adminhtml_Model_System_Config_Source_Yesno |
p/code/core/Mage/Captcha/etc/system.xml | source_model | Mage_Captcha_Model_Config_Font |
mpmd:dependencychecker:verifyThis command compares the actual dependencies detected by looking at the code with the ones declared for a given module (specify with -m <Module_Name>)
Example:
8-magerun.phar mpmd:dependencycheck:verify -m Mage_Catalog app/code/core/Mage/Catalog
------------------+---------------------------------------------+--------------+
clared Dependency | Actual Dependency | Status |
------------------+---------------------------------------------+--------------+
ge_Cms | Mage_Cms | OK |
ge_Dataflow | Mage_Dataflow | OK |
ge_Eav | Mage_Eav | OK |
ge_Index | Mage_Index | OK |
| Mage_Adminhtml | Undeclared |
| Mage_Api2 | Undeclared |
| Mage_Api | Undeclared |
| Mage_Bundle | Undeclared |
| Mage_CatalogIndex | Undeclared |
In this example you can see how Mage_Catalog only declares dependencies to Mage_Cms, Mage_Dataflow, Mage_Eav and Mage_Index. But in reality Mage_Catalog depends on many more modules…
Note: Since pointing to a directory in app/code/ will not take the layout and template files into account that might belong to a module and will potentiallu also introduce dependencies it is recommended to always include all relevant directories to the source parameter, or - in case you're using modman and everything lives in a separate directory anyway point this command to that directory instead:
magerun.phar mpmd:dependencycheck:verify -m My_Module ../.modman/My_Module
mpmd:dependencychecker:configuredThis command returns a list of all configured dependencies (taken from config xml). This (and the corresponding mpmd:dependencychecker:graph:configured) is the only command that does not analyze any files but only reads the dependencies from the configuration.
The command accepts one or more module and also supports glob-like patterns:
Examples
ngle module
8-magerun.phar mpmd:dependencycheck:configured My_Module
o modules
8-magerun.phar mpmd:dependencycheck:configured My_Module My_OtherModule
ldcard(s)
8-magerun.phar mpmd:dependencycheck:configured 'Mage_*' 'Enterprise_*'
l modules
8-magerun.phar mpmd:dependencycheck:configured '*'
Note: since bash might replace your glob syntax with different paths in case they match something in the current directory you should wrap any glob patterns in 'single quotes'/
mpmd:dependencychecker:graph:moduleThis command will render a dependency graph for the relevant modules as a dot file. Use the Graphviz tool (Ubuntu: sudo apt-get install graphviz) to create a svg (or many other formats).
Feel free to modify the dot-file to match any different styling. Find a full reference on the Graphviz website.
Example:
8-magerun.phar mpmd:dependencycheck:graph:module app/code/core/Mage/* | dot -Tsvg -o mage.svg
:
8-magerun.phar mpmd:dependencycheck:graph:module app/code/core/Mage/* > mage.dot
stomize your graph in mage.dot...
t -Tsvg mage.dot -o mage.svg
Here's a tiny(!) crop of the graph generated in this example (click the image for a full-sized svg). Sadly there are a ton of dependencies in the Magento core (and most likely also in your modules) so these graphs can quickly grow pretty huge:
mpmd:dependencychecker:graph:classWhile the previous command shows you a higher level view on modules only, mpmd:dependencychecker:graph:class will drill down into individual classes and optionally group them by module. Consider this graph “zooming in” into the modules in order to find out what classes are responsible for the dependency.
The graph shows different line types:
| Style | Type | |——–|——————————–| | Solid | Inheritance: extends, implements | | Dashed | Composition: new, type_hints, get*, blocks, source/backend/frontend_model | | Dotted | everything else (static calls) |
(This might require some better categorization (e.g. implements != inheritance, type hint != composition)
Example:
grouped
8-magerun.phar mpmd:dependencycheck:graph:class app/code/core/Mage/Captcha | dot -Tpng -o Mage_Captcha.png
ouped
8-magerun.phar mpmd:dependencycheck:graph:class --group app/code/core/Mage/Captcha | dot -Tpng -o Mage_Captcha.png
| Ungrouped | Grouped |
|——–|——————————–|
| 
| 
|
mpmd:dependencychecker:graph:configuredThis command will create a graph from the configured dependencies. The syntax is the same used in mpmd:dependencychecker:configured:
Example:
8-magerun.phar mpmd:dependencycheck:graph:configured 'Mage_*' | dot -Tsvg -o Mage.svg
Disclaimer: There's a good chance that some dependencies are not detected at all (actually if variables are being used when instanciating object like Mage::getModel($modelClass);, Mage::getModel("acme/$model"); or new $class() then mpmd is ignoring those - and there might be some more scenarious where mpmd might be missing some dependencies). Please do not solely rely on the mpmd report while refactoring or before removing any modules!
This plugin comes with unit tests. These unit tests will run outside of any n98-magerun or Magento context (they will mock everything from there). Running them by simply calling phpunit in the root directory. Also check the project out on Travis CI where the tests will be run on every commit.
nit --debug
There's a ton of things you can do with Graphviz. Starting from choosing different layouts to clustering nodes and coloring nodes and/or edges differently (e.g. by namespace or code pool?). Here are some examples:
In the following examples I replaced all nodes with simple black dots connected with black lines:
[arrowhead=vee, arrowtail=inv, arrowsize=.7, color="black"];
[fontname="verdana", fixedsize=true, width="0.3", shape=point, style="filled", fillcolor="black"];
Replace splines with straight lines:
nes=false;
Circle pattern:
ut=circo;
Radial pattern:
ut=twopi;
| Configured dependenciesmpmd:dependencycheck:graph:configured 'Mage_*' | Actual dependenciesmpmd:dependencycheck:graph:module 'app/code/core/Mage/*' |
|——–|——————————–|
| 
| 
|
No overlapping:
lap=false;
ut=twopi;
