Indexer's HTML parser currently understands the following META tags. Note that "HTTP-EQUIV" may be used instead of "NAME"
in all entries.
-
<META NAME="Content-Type" Content="text/html; charset=xxxx"> This is used to detect document character set if it is not specified
in "Content-type" HTTP header.
-
<META NAME="REFRESH" Content="5; URL=http://www.somewhere.com"> URL value will be inserted in database.
-
<META NAME="Keywords" Content="xxx">
-
<META NAME="Description" Content="xxx">
-
<META NAME="Robots" Content="xxx"> with content value ALL, NONE, INDEX, NOINDEX, FOLLOW, NOFOLLOW.
|
|
|
|
Sponsor links:
|
|
