pepepper/tissue
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Merge pull request #531 from shikorism/fix/robots-ignore-non-plain-response

Browse Source 
robots.txt取得時、text/plain以外の応答は失敗扱いにする
This commit is contained in:
shibafu 2020-10-21 20:47:19 +09:00 committed by GitHub
commit 16071f7cff
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 5 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
app/Services/MetadataResolveService.php
View File

@ -162,6 +162,11 @@ class MetadataResolveService
$client = app(Client::class);
try {
$res = $client->get($robotsUrl);
if (stripos($res->getHeaderLine('Content-Type'), 'text/plain') !== 0) {
Log::error('robots.txtの取得に失敗: 不適切なContent-Type (' . $res->getHeaderLine('Content-Type') . ')');
return null;
}
return (string) $res->getBody();
} catch (\Exception $e) {