We had attempts to integrate Magento stores with small amount of users/orders in the past with no issues. Now we are attempting to import a quite huge amount of Magento entities (700k orders, 500k customers). As result, we had throughput near ~15-20 entities per minute on the initial sync (Magento->Orocrm).
First of all, we suspected the bottleneck is on the Magento side. After some investigations we got that each SOAP request takes ~1 sec, so, the problem is not here. Then we have checked the OroCRM server state and got 100% CPU load by PHP process. After this a new OroCRM instance has been installed on a more powerful server (c3.2xlarge AWS instance with 8 CPUs). As result, we have ~20-25 entities per minute and 100% CPU load by PHP process. As we can see, the bottleneck somewhere on the OroCRM side. Since we have tried different server configurations, must assume that the hardware/system configuration problem is not supposed to be here.
Current states are the following:
– OroCRM (1.8.2) and Magento (1.9.1) installed on different servers.
– OroCRM uses a separate RDS MYSQL instance.
– Magento has OroCRM bridge extension (18.104.22.168) installed, WSDL cache enabled.
– Xdebug is disabled on both servers.
Maybe there were some changes in the recent OroCRM versions connected to the import and there are some workarounds to speed up the integration? Any help is very appreciated. Thanks.
You must be logged in to reply to this topic.