Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

IIS logs import with multiple subdomains will create entry with first entry in URLS setting #7396

Closed
FrankV1971 opened this issue Mar 9, 2015 · 2 comments
Labels
Bug For errors / faults / flaws / inconsistencies etc. worksforme The issue cannot be reproduced and things work as intended.

Comments

@FrankV1971
Copy link

When importing the IIS logs from the command line the subdomain shown in Piwik is always the first entry from the table URLS in the Website manager.

Command used:
python "C:\inetpub\piwik\misc\log-analytics\import_logs.py" --url=http://<pwik>.com/ "E:\tmp\W3SVC3\u_ex150305.log" --idsite=30 --recorders=4 --enable-http-errors --enable-http-redirects --enable-static --enable-bots

I altered the log file
domains used: sub1.domain.com - sub7.domain.com
IP addresses are also fake.

For testing I started the import. with sub1.domain.com, paused the import after a while and changed the list of domains in the Website manager and then resumed the import. From that point a new subdomain was used in the import.

sample logfile
2015-03-05 11:06:46 W3SVC3 Server1 123.123.123.123 GET /App_Themes/sub5/AA/css/General.css buildnr=134 443 - 19.24.3.8 HTTP/1.1 Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10.9;+rv:37.0)+Gecko/20100101+Firefox/37.0 _pk_id.11.6920=fa40158dc6a5a738.1423057331.3.1425553400.1425553385.;+ASP.NET_SessionId=fk25qz3w5v3dymlgvrtinfwy;+_pk_ses.11.6920=* https://sub5.domain.com/AA/Guideline.aspx sub5.domain.com 304 0 0 245 612 15 2015-03-05 11:06:46 W3SVC3 Server1 123.123.123.123 GET /App_Themes/Productx/AA/css/ShowplaceMaster.css buildnr=134 443 - 19.24.3.8 HTTP/1.1 Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10.9;+rv:37.0)+Gecko/20100101+Firefox/37.0 _pk_id.11.6920=fa40158dc6a5a738.1423057331.3.1425553400.1425553385.;+ASP.NET_SessionId=fk25qz3w5v3dymlgvrtinfwy;+_pk_ses.11.6920=* https://sub5.domain.com/AA/Guideline.aspx sub5.domain.com 304 0 0 245 625 15 2015-03-05 11:06:46 W3SVC3 Server1 123.123.123.123 GET /App_Themes/sub5/AA/css/ShowplaceMaster.css buildnr=134 443 - 19.24.3.8 HTTP/1.1 Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10.9;+rv:37.0)+Gecko/20100101+Firefox/37.0 _pk_id.11.6920=fa40158dc6a5a738.1423057331.3.1425553400.1425553385.;+ASP.NET_SessionId=fk25qz3w5v3dymlgvrtinfwy;+_pk_ses.11.6920=* https://sub5.domain.com/AA/Guideline.aspx sub5.domain.com 304 0 0 245 620 15 2015-03-05 11:06:46 W3SVC3 Server1 123.123.123.123 GET /App_Themes/Productx/AA/css/ShowPlacesGeneral.css buildnr=134 443 - 19.24.3.8 HTTP/1.1 Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10.9;+rv:37.0)+Gecko/20100101+Firefox/37.0 _pk_id.11.6920=fa40158dc6a5a738.1423057331.3.1425553400.1425553385.;+ASP.NET_SessionId=fk25qz3w5v3dymlgvrtinfwy;+_pk_ses.11.6920=* https://sub5.domain.com/AA/Guideline.aspx sub5.domain.com 304 0 0 245 627 15 2015-03-05 11:06:46 W3SVC3 Server1 123.123.123.123 GET /App_Themes/sub5/AA/css/ShowPlacesGeneral.css buildnr=134 443 - 19.24.3.8 HTTP/1.1 Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10.9;+rv:37.0)+Gecko/20100101+Firefox/37.0 _pk_id.11.6920=fa40158dc6a5a738.1423057331.3.1425553400.1425553385.;+ASP.NET_SessionId=fk25qz3w5v3dymlgvrtinfwy;+_pk_ses.11.6920=* https://sub5.domain.com/AA/Guideline.aspx sub5.domain.com 304 0 0 245 622 31 2015-03-05 11:06:46 W3SVC3 Server1 123.123.123.123 GET /App_Themes/Productx/ProductxGeneral/Icons.css buildnr=134 443 - 19.24.3.8 HTTP/1.1 Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10.9;+rv:37.0)+Gecko/20100101+Firefox/37.0 _pk_id.11.6920=fa40158dc6a5a738.1423057331.3.1425553400.1425553385.;+ASP.NET_SessionId=fk25qz3w5v3dymlgvrtinfwy;+_pk_ses.11.6920=* https://sub5.domain.com/AA/Guideline.aspx sub5.domain.com 304 0 0 245 624 15 2015-03-05 11:06:46 W3SVC3 Server1 123.123.123.123 GET /App_Themes/sub5/AA/banners/gagagaerg/override.css buildnr=134 443 - 19.24.3.8 HTTP/1.1 Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10.9;+rv:37.0)+Gecko/20100101+Firefox/37.0 _pk_id.11.6920=fa40158dc6a5a738.1423057331.3.1425553400.1425553385.;+ASP.NET_SessionId=fk25qz3w5v3dymlgvrtinfwy;+_pk_ses.11.6920=* https://sub5.domain.com/AA/Guideline.aspx sub5.domain.com 304 0 0 245 662 15 2015-03-05 11:06:46 W3SVC3 Server1 123.123.123.123 GET /App_Themes/sub5/Usercontrols/css/Breadcrumb.css buildnr=134 443 - 19.24.3.8 HTTP/1.1 Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10.9;+rv:37.0)+Gecko/20100101+Firefox/37.0 _pk_id.11.6920=fa40158dc6a5a738.1423057331.3.1425553400.1425553385.;+ASP.NET_SessionId=fk25qz3w5v3dymlgvrtinfwy;+_pk_ses.11.6920=* https://sub5.domain.com/AA/Guideline.aspx sub5.domain.com 304 0 0 245 625 15 2015-03-05 11:06:46 W3SVC3 Server1 123.123.123.123 GET /App_Themes/Productx/General/headers/sf_Productx_styling.css buildnr=134 443 - 19.24.3.8 HTTP/1.1 Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10.9;+rv:37.0)+Gecko/20100101+Firefox/37.0 _pk_id.11.6920=fa40158dc6a5a738.1423057331.3.1425553400.1425553385.;+ASP.NET_SessionId=fk25qz3w5v3dymlgvrtinfwy;+_pk_ses.11.6920=* https://sub5.domain.com/AA/Guideline.aspx sub5.domain.com 304 0 0 245 638 31 2015-03-05 11:06:46 W3SVC3 Server1 123.123.123.123 GET /App_Themes/sub5/General/headers/sf_Productx_styling.css buildnr=134 443 - 19.24.3.8 HTTP/1.1 Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10.9;+rv:37.0)+Gecko/20100101+Firefox/37.0 _pk_id.11.6920=fa40158dc6a5a738.1423057331.3.1425553400.1425553385.;+ASP.NET_SessionId=fk25qz3w5v3dymlgvrtinfwy;+_pk_ses.11.6920=* https://sub5.domain.com/AA/Guideline.aspx sub5.domain.com 304 0 0 245 633 31 2015-03-05 11:10:27 W3SVC3 Server1 123.123.123.123 GET /App_Themes/Productx/Telerik/Telerik.domain.less - 443 - 181.145.166.12 HTTP/1.1 Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10.10;+rv:36.0)+Gecko/20100101+Firefox/36.0 _pk_id.11.5e12=ef9ca130e15b2e62.1423645729.7.1425553827.1425551829.;+ASP.NET_SessionId=ecalh21kdd1cgmlfejxlsvne;+_pk_ses.11.5e12=* https://sub6.domain.com/App_Themes/Productx/default/css/style.css sub6.domain.com 200 0 0 2517 591 140 2015-03-05 11:10:27 W3SVC3 Server1 123.123.123.123 GET /App_Themes/img/widgetBackground.gif - 443 - 181.145.166.12 HTTP/1.1 Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10.10;+rv:36.0)+Gecko/20100101+Firefox/36.0 _pk_id.11.5e12=ef9ca130e15b2e62.1423645729.7.1425553827.1425551829.;+ASP.NET_SessionId=ecalh21kdd1cgmlfejxlsvne;+_pk_ses.11.5e12=* https://sub6.domain.com/App_Themes/UserControls/SearchWidgetIS.css?buildnr=134 sub6.domain.com 404 0 2 1445 604 109 2015-03-05 11:10:28 W3SVC3 Server1 123.123.123.123 GET / - 443 - 118.176.68.155 HTTP/1.1 Mozilla/5.0+(compatible;+MSIE+9.0;+Windows+NT+6.1;+Trident/5.0) - - sub7.domain.com 200 0 0 15477 254 124 2015-03-05 11:10:28 W3SVC3 Server1 123.123.123.123 GET /App_Themes/Product_login.css - 443 - 118.176.68.155 HTTP/1.1 Mozilla/5.0+(compatible;+MSIE+9.0;+Windows+NT+6.1;+Trident/5.0) ASP.NET_SessionId=zrawqgb33cf0j0czyw21r15v https://sub7.domain.com/ sub7.domain.com 200 0 0 6021 445 31 2015-03-05 11:10:28 W3SVC3 Server1 123.123.123.123 GET /App_Themes/Product_login.css - 443 - 118.176.68.155 HTTP/1.1 Mozilla/5.0+(compatible;+MSIE+9.0;+Windows+NT+6.1;+Trident/5.0) ASP.NET_SessionId=zrawqgb33cf0j0czyw21r15v https://sub7.domain.com/ sub7.domain.com 200 0 0 1909 445 46 2015-03-05 11:11:43 W3SVC3 Server1 123.123.123.123 GET /App_Themes/sub3/BDM/Attachments.css buildnr=134 443 - 185.52.208.194 HTTP/1.1 Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10_10_1)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Chrome/40.0.2214.115+Safari/537.36 ASP.NET_SessionId=2yltjhhjl2vyhcbr05dicqbj;+_pk_ref.11.7bae=%5B%22%22%2C%22%22%2C1425553225%2C%22https%3A%2F%2Foutlook.office365.com%2Fowa%2F%3Frealm%3Dabrandnewday.nl%22%5D;+_pk_id.11.7bae=4c9fa0099b492ab4.1405933533.111.1425553903.1425553225.;+_pk_ses.11.7bae=* https://sub3.domain.com/BM/Coop/Action.aspx?session=svIrCyOCZAmPvmLMfXNKGU5GYfmUmOV7M6HCTQh9axns20OBJzxzCnbqrugHZDmX0 sub3.domain.com 404 0 2 1445 802 0 2015-03-05 11:11:43 W3SVC3 Server1 123.123.123.123 GET /App_Themes/sub3/Telerik/Telerik.domain.less - 443 - 185.52.208.194 HTTP/1.1 Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10_10_1)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Chrome/40.0.2214.115+Safari/537.36 ASP.NET_SessionId=2yltjhhjl2vyhcbr05dicqbj;+_pk_ref.11.7bae=%5B%22%22%2C%22%22%2C1425553225%2C%22https%3A%2F%2Foutlook.office365.com%2Fowa%2F%3Frealm%3Dabrandnewday.nl%22%5D;+_pk_id.11.7bae=4c9fa0099b492ab4.1405933533.111.1425553903.1425553225.;+_pk_ses.11.7bae=* https://sub3.domain.com/BM/Coop/Action.aspx?session=svIrCyOCZAmPvmLMfXNKGU5GYfmUmOV7M6HCTQh9axns20OBJzxzCnbqrugHZDmX0 sub3.domain.com 200 0 0 421 801 0 2015-03-05 11:11:43 W3SVC3 Server1 123.123.123.123 GET /App_Themes/Productx/Telerik/Telerik.domain.less - 443 - 185.52.208.194 HTTP/1.1 Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10_10_1)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Chrome/40.0.2214.115+Safari/537.36 ASP.NET_SessionId=2yltjhhjl2vyhcbr05dicqbj;+_pk_ref.11.7bae=%5B%22%22%2C%22%22%2C1425553225%2C%22https%3A%2F%2Foutlook.office365.com%2Fowa%2F%3Frealm%3Dabrandnewday.nl%22%5D;+_pk_id.11.7bae=4c9fa0099b492ab4.1405933533.111.1425553903.1425553225.;+_pk_ses.11.7bae=* https://sub3.domain.com/BM/Coop/Action.aspx?session=svIrCyOCZAmPvmLMfXNKGU5GYfmUmOV7M6HCTQh9axns20OBJzxzCnbqrugHZDmX0 sub3.domain.com 200 0 0 2517 805 62 2015-03-05 11:11:46 W3SVC3 Server1 123.123.123.123 POST /landingpage.aspx - 443 - 14.11.25.21 HTTP/1.1 Mozilla/5.0+(compatible;+MSIE+10.0;+Windows+NT+6.1;+Trident/6.0) _pk_id.11.6063=e9fd48553a63cd71.1405938555.31.1425553903.1425553899.;+_pk_ref.11.6063=%5B%22%22%2C%22%22%2C1425553899%2C%22https%3A%2F%2Fwww.google.nl%2Furl%3Fsa%3Dt%26rct%3Dj%26q%3D%26esrc%3Ds%26frm%3D1%26source%3Dweb%26cd%3D1%26ved%3D0CCIQFjAA%26url%3Dhttps%3A%2F%2Fsub4.domain.com%2F%26ei%3DcCv4VObNF83XPMqCgZgL%26usg%3DAFQjCNHQannt8XfnmpKrroTjZxhUN9G_7A%26sig2%3DGeDvD23SnuKF88v3SNj8fw%26bvm%3Dbv.87519884%2Cd.ZWU%22%5D;+ASP.NET_SessionId=mvudsfkaki4dkao4rk3edmtn;+_pk_ses.11.6063=* https://sub4.domain.com/landingpage.aspx sub4.domain.com 302 0 0 677 8270 421 2015-03-05 11:11:51 W3SVC3 Server1 123.123.123.123 POST /AA/MediaLibraryIs.aspx - 443 - 181.16.67.17 HTTP/1.1 Mozilla/5.0+(Windows+NT+5.1)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Chrome/40.0.2214.115+Safari/537.36 ASP.NET_SessionId=srsesixszkx0cpx2ccagyatn;+_pk_ref.11.cdf3=%5B%22%22%2C%22%22%2C1425553682%2C%22https%3A%2F%2Fwww.google.co.uk%2F%22%5D;+_pk_id.11.cdf3=f53882a2a2dafc3d.1423473285.12.1425553684.1425553682.;+_pk_ses.11.cdf3=* https://sub1.domain.com/AA/MediaLibraryIs.aspx sub1.domain.com 200 0 0 293754 224145 3015 2015-03-05 11:11:51 W3SVC3 Server1 123.123.123.123 GET /UserControls/DigitalAsset/Images/icon_drawing.gif - 443 - 181.16.67.17 HTTP/1.1 Mozilla/5.0+(Windows+NT+5.1)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Chrome/40.0.2214.115+Safari/537.36 ASP.NET_SessionId=srsesixszkx0cpx2ccagyatn;+_pk_ref.11.cdf3=%5B%22%22%2C%22%22%2C1425553682%2C%22https%3A%2F%2Fwww.google.co.uk%2F%22%5D;+_pk_id.11.cdf3=f53882a2a2dafc3d.1423473285.12.1425553684.1425553682.;+_pk_ses.11.cdf3=* https://sub1.domain.com/AA/MediaLibraryIs.aspx sub1.domain.com 200 0 0 997 651 218 2015-03-05 11:11:53 W3SVC3 Server1 123.123.123.123 POST /BM/Coop/Action.aspx session=svIrCyOCZAmPvmLMfXNKGU5GYfmUmOV7M6HCTQh9axns20OBJzxzCnbqrugHZDmX0 443 - 185.52.208.194 HTTP/1.1 Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10_10_1)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Chrome/40.0.2214.115+Safari/537.36 ASP.NET_SessionId=2yltjhhjl2vyhcbr05dicqbj;+_pk_ref.11.7bae=%5B%22%22%2C%22%22%2C1425553225%2C%22https%3A%2F%2Foutlook.office365.com%2Fowa%2F%3Frealm%3Dabrandnewday.nl%22%5D;+_pk_id.11.7bae=4c9fa0099b492ab4.1405933533.111.1425553908.1425553225.;+_pk_ses.11.7bae=* https://sub3.domain.com/BM/Coop/Action.aspx?session=svIrCyOCZAmPvmLMfXNKGU5GYfmUmOV7M6HCTQh9axns20OBJzxzCnbqrugHZDmX0 sub3.domain.com 200 0 0 126440 73001 593 2015-03-05 11:12:46 W3SVC3 Server1 123.123.123.123 POST /landingpage.aspx SessionExpired=True 443 - 16.8.6.6 HTTP/1.1 Mozilla/5.0+(Windows+NT+6.1;+WOW64)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Chrome/40.0.2214.115+Safari/537.36 ASP.NET_SessionId=1quhwxv54ce4owcfslrnk2rn;+_pk_ref.11.5b9e=%5B%22%22%2C%22%22%2C1425553584%2C%22https%3A%2F%2Fmail.google.com%2Fmail%2Fu%2F0%2F%3Fui%3D2%26shva%3D1%22%5D;+_pk_id.11.5b9e=1d8689cd023ae0cb.1423891125.4.1425553893.1425553584.;+_pk_ses.11.5b9e=* https://sub2.domain.com/landingpage.aspx?SessionExpired=True sub2.domain.com 302 0 0 485 2719 890 2015-03-05 11:12:47 W3SVC3 Server1 123.123.123.123 GET /AA/ShowplaceCategory.aspx SessionExpired=True 443 - 16.8.6.6 HTTP/1.1 Mozilla/5.0+(Windows+NT+6.1;+WOW64)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Chrome/40.0.2214.115+Safari/537.36 ASP.NET_SessionId=1quhwxv54ce4owcfslrnk2rn;+_pk_ref.11.5b9e=%5B%22%22%2C%22%22%2C1425553584%2C%22https%3A%2F%2Fmail.google.com%2Fmail%2Fu%2F0%2F%3Fui%3D2%26shva%3D1%22%5D;+_pk_id.11.5b9e=1d8689cd023ae0cb.1423891125.4.1425553893.1425553584.;+_pk_ses.11.5b9e=* https://sub2.domain.com/landingpage.aspx?SessionExpired=True sub2.domain.com 302 0 0 437 775 531 2015-03-05 11:12:47 W3SVC3 Server1 123.123.123.123 GET /AA/ShowplaceCategory.aspx - 443 - 16.8.6.6 HTTP/1.1 Mozilla/5.0+(Windows+NT+6.1;+WOW64)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Chrome/40.0.2214.115+Safari/537.36 ASP.NET_SessionId=1quhwxv54ce4owcfslrnk2rn;+_pk_ref.11.5b9e=%5B%22%22%2C%22%22%2C1425553584%2C%22https%3A%2F%2Fmail.google.com%2Fmail%2Fu%2F0%2F%3Fui%3D2%26shva%3D1%22%5D;+_pk_id.11.5b9e=1d8689cd023ae0cb.1423891125.4.1425553893.1425553584.;+_pk_ses.11.5b9e=* https://sub2.domain.com/landingpage.aspx?SessionExpired=True sub2.domain.com 302 0 0 421 755 468 2015-03-05 11:12:47 W3SVC3 Server1 123.123.123.123 GET /AA/Showplace.aspx - 443 - 16.8.6.6 HTTP/1.1 Mozilla/5.0+(Windows+NT+6.1;+WOW64)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Chrome/40.0.2214.115+Safari/537.36 ASP.NET_SessionId=1quhwxv54ce4owcfslrnk2rn;+_pk_ref.11.5b9e=%5B%22%22%2C%22%22%2C1425553584%2C%22https%3A%2F%2Fmail.google.com%2Fmail%2Fu%2F0%2F%3Fui%3D2%26shva%3D1%22%5D;+_pk_id.11.5b9e=1d8689cd023ae0cb.1423891125.4.1425553893.1425553584.;+_pk_ses.11.5b9e=* https://sub2.domain.com/landingpage.aspx?SessionExpired=True sub2.domain.com 302 0 0 437 747 484 2015-03-05 11:12:48 W3SVC3 Server1 123.123.123.123 POST /AA/ShowplaceCategory.aspx - 443 - 187.18.6.65 HTTP/1.1 Mozilla/5.0+(compatible;+MSIE+10.0;+Windows+NT+6.1;+WOW64;+Trident/6.0;+FSJB) _pk_ref.11.cdf3=%5B%22%22%2C%22%22%2C1425552609%2C%22http%3A%2F%2Fwww.google.de%2Furl%3Fsa%3Dt%26rct%3Dj%26q%3D%26esrc%3Ds%26frm%3D1%26source%3Dweb%26cd%3D1%26ved%3D0CDUQFjAA%26url%3Dhttp%3A%2F%2Fwww.sub1partnerportal.com%2F%26ei%3D3TT4VPG_KMXuUNWog5gL%26usg%3DAFQjCNFIwJlDI1QtwvV-om2hYTQtOGinAA%26bvm%3Dbv.87519884%2Cd.ZWU%22%5D;+_pk_id.11.cdf3=3df1255f35ede139.1418047750.18.1425553959.1425552609.;+ASP.NET_SessionId=5elnoxfjgb0hw0p0l2ssrvvn;+_pk_ses.11.cdf3=* https://sub1.domain.com/AA/ShowplaceCategory.aspx sub1.domain.com 302 0 0 565 9490 187

@mattab
Copy link
Member

mattab commented Apr 8, 2015

@FrankV1971

Here is how it should work:

  • if the subdomain is specified in the log file, piwik should use this sub-domain to record the Page URL
  • if the sub-domain is not specified in the log file, Piwik will use the first URL set in the Website "URLs" textarea in the admin

Does it work as expected for you?

@mattab mattab added the Bug For errors / faults / flaws / inconsistencies etc. label Apr 8, 2015
@mattab mattab added this to the Short term milestone Apr 8, 2015
@mattab
Copy link
Member

mattab commented Sep 11, 2015

Hi @FrankV1971 could you please try with latest 2.15.0-beta and check if this bug is fixed? piwik.org/faq/how-to-update/faq_159/

@mattab mattab closed this as completed Sep 18, 2018
@mattab mattab added the worksforme The issue cannot be reproduced and things work as intended. label Sep 18, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug For errors / faults / flaws / inconsistencies etc. worksforme The issue cannot be reproduced and things work as intended.
Projects
None yet
Development

No branches or pull requests

2 participants