Direcionando log Squid para banco MySQL

Este artigo traz algumas explicações sobre o LOG do Squid e como direcioná-lo para o banco de dados MySQL.

[ Hits: 87.653 ]

Por: Filipe Binat Gallo em 26/11/2007


Entendendo o log do Squid



Os logs fornecem muitas informações sobre as operações que estão ocorrendo, dentre os diversos logs gerados pelo Squid, o mais importante é o access.log, que pode ser especificado dentro do arquivo squid.conf na seguinte linha:

# To log the request via syslog specify a filepath of "syslog"
access_log /dados/squid/log/access.log squid

Onde você pode, assim como fiz, especificar a pasta que desejar para o log.

Este log registra informações da maneira como mostrado abaixo:

1193839941.740      10 192.168.20.100 TCP_DENIED/407 0 GET http://www.hcrp.fmrp.usp.br/rh/imagens/ftv2doc.gif - NONE/- text/html

Vamos descrever o significado de cada item:
  • 1193839941.740: A hora da solicitação, especificada na quantidade de milissegundos que se passaram desde Thu Jan 1 00:00:00 UTC 1970. Você pode usar um simples comando Perl para converter o Unix hora em hora local. Por exemplo, estando na pasta do log, digite:

    $ perl -pe 's/^\d+\.\d+/localtime($&)/e;' access.log

  • 10: Quanto tempo se levou para processar o pedido, do momento em que a requisição HTTP foi feita.

  • 192.168.20.100: Endereço IP do cliente que solicitou a página.

  • TCP_DENIED/407: O primeiro valor classifica o resultado de uma transação (e.g., TCP_HIT ou UDP_DENIED). Estes códigos que começam com TCP_ referem-se a pedidos HTTP, enquanto UDP_ refere-se a consultas ICP.

    Abaixo estão alguns dos códigos mais comuns:

    TCP_HIT: Squid encontrou uma provável nova cópia do recurso solicitado e os envia imediatamente para o cliente.

    TCP_MISS: Squid não possui uma cópia em cache do recurso solicitado.

    TCP_REFRESH_HIT: Squid encontrou um provável cópia do recurso solicitado e enviou um pedido ao servidor origem caso o servidor envie um 304 (Not Modified) como resposta, significa que a cópia do Squid ainda está fresca.

    O segundo valor /407 é o código de resposta HTTP (ex., 200, 304, 404, etc). O código de status normalmente vem do servidor origem do objeto solicitado. Em alguns casos, no entanto o Squid pode ser responsável por selecionar o código de status. Neste caso o código 407 indica que a autenticação é requerida.

    Segue abaixo alguns outros exemplos de códigos-resposta:

    1xx Information
    100 Continue
    101 Switching Protocols

    2xx Success
    200 OK
    201 Created
    202 Accepted
    203 Non-Authoritative Information

    4xx Client Error
    400 Bad Request
    401 Unauthorized
    402 Payment Required
    403 Forbidden
    404 Not Found
    405 Method Not Allowed
    406 Not Acceptable
    407 Proxy Authentication Required

  • 0: Este campo indica a quantidade de bytes transferida para o cliente, neste exemplo, como a requisição foi negada (TCP_DENIED), nada foi enviado ao cliente.

  • http://www.hcrp.fmrp.usp.br/rh/imagens/ftv2doc.gif: Esta é propriamente a URL do objeto solicitado pelo usuário.

  • NONE/- : O squid permite que se trabalhe usando outros servidores cache como consulta, assim aqui fica registrado como ocorreu esta negociação, em nosso caso como a requisição fora negada o proxy, nem mesmo consultou nenhum outro servidor, caso o proxy tivesse acessado o conteúdo diretamente seria registrado como isto; DIRECT/200.136.57.246, o valor DIRECT seguido do IP de destino.

  • text/html: O último campo é o tipo de conteúdo da resposta HTTP. O Squid obtém o valor do tipo de conteúdo da resposta do cabeçalho Content - Type. Se o cabeçalho está faltando então será utilizado um hífen (-).

Agora que já falamos sobre um pouco sobre a estrutura do log gerado pelo SQUID, vamos começar a preparar nossas lista de pacotes necessários para prosseguirmos.

    Próxima página

Páginas do artigo
   1. Entendendo o log do Squid
   2. Preparando os aplicativos necessários
   3. Editando o access_log.c
   4. Compilando o Squid
   5. Conclusões
Outros artigos deste autor

Postfix - Integração AD e autenticação

Leitura recomendada

A verdade sobre as ACLs do Squid

Squid autenticando em Windows 2003 com msnt_auth

Configurando o Squid no Slackware

Compilação do Squid 3 no Debian Wheezy

Controle de acesso à internet com Squid

  
Comentários
[1] Comentário enviado por wellcastellani em 26/11/2007 - 14:30h

Muito util esta solução, vlw pela contribuição!

[2] Comentário enviado por agk em 26/11/2007 - 16:18h

Muito bom, parabéns, mas vejo um pequeno problema nisso, como que vai ficar o tamanho do banco depois de uns 3 meses ou daqui 1 ano?

Teria que ter um esquema de rotação ou dump em dvd mensal e limpeza do banco.

São algumas idéias, mas o projeto é bom, realmente parabéns pela iniciativa.

[3] Comentário enviado por balani em 26/11/2007 - 17:46h

Cara, vc acertou na veia, é isso que eu estava procurando, muito bom, isso sera muito util para mim, obrigado pela contribuição!!

[4] Comentário enviado por m@verick em 26/11/2007 - 18:39h

Bem lembrado agk, estarei fazendo uma pesquisa e nas proximas semanas estarei postando um script para isso

[5] Comentário enviado por balani em 11/12/2007 - 08:56h

Bom dia, sua solução é oque eu estou querendo, porem, ao aplica-la apresentou o seguinte erro:
access_log.c: In function 'accessLogSquid':
access_log.c:1033: error: missing terminating " character
access_log.c:1034: error: expected ')' before ';' token
access_log.c:1066: error: expected ';' before '}' token
access_log.c:1070: error: invalid storage class for function 'accessLogCommon'
access_log.c:1271: error: expected declaration or statement at end of input
make[3]: *** [access_log.o] Error 1
make[3]: Leaving directory `/usr/src/Squid+htb/squid-2.6.STABLE17/src'
make[2]: *** [all-recursive] Error 1
make[2]: Leaving directory `/usr/src/Squid+htb/squid-2.6.STABLE17/src'
make[1]: *** [all] Error 2
make[1]: Leaving directory `/usr/src/Squid+htb/squid-2.6.STABLE17/src'
make: *** [all-recursive] Error 1

Se vc poder me ajudar, ficarei muito grato.

[6] Comentário enviado por m@verick em 11/12/2007 - 12:52h

Balani, por favor poste todo o seu arquivo accesslog.c para que eu possa dar uma olhada.
Deve ser algo na ordem em que foi inserido o codigo para gerar a string SQL.
Ok Obrigdo

[7] Comentário enviado por balani em 12/12/2007 - 11:16h

Olá amigo, obrigado pela atenção, abaixo segue o codigo:

/*
* $Id: access_log.c,v 1.95.2.2 2007/06/03 00:40:32 hno Exp $
*
* DEBUG: section 46 Access Log
* AUTHOR: Duane Wessels
*
* SQUID Web Proxy Cache http://www.squid-cache.org/
* ----------------------------------------------------------
*
* Squid is the result of efforts by numerous individuals from
* the Internet community; see the CONTRIBUTORS file for full
* details. Many organizations have provided support for Squid's
* development; see the SPONSORS file for full details. Squid is
* Copyrighted (C) 2001 by the Regents of the University of
* California; see the COPYRIGHT file for full details. Squid
* incorporates software developed and/or copyrighted by other
* sources; see the CREDITS file for full details.
*
* This program is free software; you can redistribute it and/or modify
* it under the terms of the GNU General Public License as published by
* the Free Software Foundation; either version 2 of the License, or
* (at your option) any later version.
*
* This program is distributed in the hope that it will be useful,
* but WITHOUT ANY WARRANTY; without even the implied warranty of
* MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
* GNU General Public License for more details.
*
* You should have received a copy of the GNU General Public License
* along with this program; if not, write to the Free Software
* Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA 02111, USA.
*
*/


#include "squid.h"
#include <mysql/mysql.h>
#include <stdlib.h>
#include <stdio.h>

char insertSQL[400];
char intconvstr[5];
int res;
MYSQL conexao;

#if HEADERS_LOG
static Logfile *headerslog = NULL;
#endif

#if MULTICAST_MISS_STREAM
static int mcast_miss_fd = -1;
static struct sockaddr_in mcast_miss_to;
static void mcast_encode(unsigned int *, size_t, const unsigned int *);
#endif

#if FORW_VIA_DB
typedef struct {
hash_link hash;
int n;
} fvdb_entry;
static hash_table *via_table = NULL;
static hash_table *forw_table = NULL;
static void fvdbInit(void);
static void fvdbDumpTable(StoreEntry * e, hash_table * hash);
static void fvdbCount(hash_table * hash, const char *key);
static OBJH fvdbDumpVia;
static OBJH fvdbDumpForw;
static FREE fvdbFreeEntry;
static void fvdbClear(void);
#endif

static int LogfileStatus = LOG_DISABLE;
#define LOG_BUF_SZ (MAX_URL<<2)

static const char c2x[] =
"000102030405060708090a0b0c0d0e0f"
"101112131415161718191a1b1c1d1e1f"
"202122232425262728292a2b2c2d2e2f"
"303132333435363738393a3b3c3d3e3f"
"404142434445464748494a4b4c4d4e4f"
"505152535455565758595a5b5c5d5e5f"
"606162636465666768696a6b6c6d6e6f"
"707172737475767778797a7b7c7d7e7f"
"808182838485868788898a8b8c8d8e8f"
"909192939495969798999a9b9c9d9e9f"
"a0a1a2a3a4a5a6a7a8a9aaabacadaeaf"
"b0b1b2b3b4b5b6b7b8b9babbbcbdbebf"
"c0c1c2c3c4c5c6c7c8c9cacbcccdcecf"
"d0d1d2d3d4d5d6d7d8d9dadbdcdddedf"
"e0e1e2e3e4e5e6e7e8e9eaebecedeeef"
"f0f1f2f3f4f5f6f7f8f9fafbfcfdfeff";

/* log_quote -- URL-style encoding on MIME headers. */

char *
log_quote(const char *header)
{
int c;
int i;
char *buf;
char *buf_cursor;
if (header == NULL) {
buf = xcalloc(1, 1);
*buf = '{COMENTARIO}';
return buf;
}
buf = xcalloc(1, (strlen(header) * 3) + 1);
buf_cursor = buf;
/*
* We escape: \x00-\x1F"#%;<>?{}|\\\\^~`\[\]\x7F-\xFF
* which is the default escape list for the CPAN Perl5 URI module
* modulo the inclusion of space (x40) to make the raw logs a bit
* more readable.
*/
while ((c = *(const unsigned char *) header++) != '{COMENTARIO}') {
#if !OLD_LOG_MIME
if (c == '\r') {
*buf_cursor++ = '\\';
*buf_cursor++ = 'r';
} else if (c == '\n') {
*buf_cursor++ = '\\';
*buf_cursor++ = 'n';
} else
#endif
if (c <= 0x1F
|| c >= 0x7F
|| c == '%'
#if OLD_LOG_MIME
|| c == '"'
|| c == '#'
|| c == ';'
|| c == '<'
|| c == '>'
|| c == '?'
|| c == '{'
|| c == '}'
|| c == '|'
|| c == '\\'
|| c == '^'
|| c == '~'
|| c == '`'
#endif
|| c == '['
|| c == ']') {
*buf_cursor++ = '%';
i = c * 2;
*buf_cursor++ = c2x[i];
*buf_cursor++ = c2x[i + 1];
#if !OLD_LOG_MIME
} else if (c == '\\') {
*buf_cursor++ = '\\';
*buf_cursor++ = '\\';
#endif
} else {
*buf_cursor++ = (char) c;
}
}
*buf_cursor = '{COMENTARIO}';
return buf;
}

static char *
username_quote(const char *header)
/* copy of log_quote. Bugs there will be found here */
{
int c;
int i;
char *buf;
char *buf_cursor;
if (header == NULL) {
buf = xcalloc(1, 1);
*buf = '{COMENTARIO}';
return buf;
}
buf = xcalloc(1, (strlen(header) * 3) + 1);
buf_cursor = buf;
/*
* We escape: space \x00-\x1F and space (0x40) and \x7F-\xFF
* to prevent garbage in the logs. CR and LF are also there just in case.
*/
while ((c = *(const unsigned char *) header++) != '{COMENTARIO}') {
if (c == '\r') {
*buf_cursor++ = '\\';
*buf_cursor++ = 'r';
} else if (c == '\n') {
*buf_cursor++ = '\\';
*buf_cursor++ = 'n';
} else if (c <= 0x1F
|| c >= 0x7F
|| c == '%'
|| c == ' ') {
*buf_cursor++ = '%';
i = c * 2;
*buf_cursor++ = c2x[i];
*buf_cursor++ = c2x[i + 1];
} else {
*buf_cursor++ = (char) c;
}
}
*buf_cursor = '{COMENTARIO}';
return buf;
}

static char *
accessLogFormatName(const char *name)
{
if (NULL == name)
return NULL;
if (name[0] == '{COMENTARIO}')
return NULL;
return username_quote(name);
}

static char *
log_quoted_string(const char *str)
{
char *out = xmalloc(strlen(str) * 2 + 1);
char *p = out;
while (*str) {
int l = strcspn(str, "\"\\\r\n\t");
memcpy(p, str, l);
str += l;
p += l;
switch (*str) {
case '{COMENTARIO}':
break;
case '\r':
*p++ = '\\';
*p++ = 'r';
str++;
break;
case '\n':
*p++ = '\\';
*p++ = 'n';
str++;
break;
case '\t':
*p++ = '\\';
*p++ = 't';
str++;
break;
default:
*p++ = '\\';
*p++ = *str;
str++;
break;
}
}
*p++ = '{COMENTARIO}';
return out;
}

/*
* Bytecodes for the configureable logformat stuff
*/
typedef enum {
LFT_NONE, /* dummy */
LFT_STRING,

LFT_CLIENT_IP_ADDRESS,
LFT_CLIENT_FQDN,
LFT_CLIENT_PORT,

/*LFT_SERVER_IP_ADDRESS, */
LFT_SERVER_IP_OR_PEER_NAME,
/*LFT_SERVER_PORT, */

LFT_LOCAL_IP,
LFT_LOCAL_PORT,
/*LFT_LOCAL_NAME, */

LFT_TIME_SECONDS_SINCE_EPOCH,
LFT_TIME_SUBSECOND,
LFT_TIME_LOCALTIME,
LFT_TIME_GMT,
LFT_TIME_TO_HANDLE_REQUEST,

LFT_REQUEST_HEADER,
LFT_REQUEST_HEADER_ELEM,
LFT_REQUEST_ALL_HEADERS,

LFT_REPLY_HEADER,
LFT_REPLY_HEADER_ELEM,
LFT_REPLY_ALL_HEADERS,

LFT_USER_NAME,
LFT_USER_LOGIN,
/*LFT_USER_REALM, */
/*LFT_USER_SCHEME, */
LFT_USER_IDENT,
LFT_USER_EXT,
#if USE_SSL
LFT_USER_SSL,
#endif

LFT_HTTP_CODE,
/*LFT_HTTP_STATUS, */

LFT_SQUID_STATUS,
/*LFT_SQUID_ERROR, */
LFT_SQUID_HIERARCHY,

LFT_MIME_TYPE,

LFT_REQUEST_METHOD,
LFT_REQUEST_URI,
/*LFT_REQUEST_QUERY, * // * this is not needed. see strip_query_terms */
LFT_REQUEST_VERSION,

LFT_REQUEST_SIZE_TOTAL,
/*LFT_REQUEST_SIZE_LINE, */
/*LFT_REQUEST_SIZE_HEADERS, */
/*LFT_REQUEST_SIZE_BODY, */
/*LFT_REQUEST_SIZE_BODY_NO_TE, */

LFT_REPLY_SIZE_TOTAL,
/*LFT_REPLY_SIZE_LINE, */
/*LFT_REPLY_SIZE_HEADERS, */
/*LFT_REPLY_SIZE_BODY, */
/*LFT_REPLY_SIZE_BODY_NO_TE, */

LFT_IO_SIZE_TOTAL,

LFT_EXT_LOG,

LFT_PERCENT /* special string cases for escaped chars */
} logformat_bcode_t;

enum log_quote {
LOG_QUOTE_NONE = 0,
LOG_QUOTE_QUOTES,
LOG_QUOTE_BRAKETS,
LOG_QUOTE_URL,
LOG_QUOTE_RAW
};
struct _logformat_token {
logformat_bcode_t type;
union {
char *string;
struct {
char *header;
char *element;
char separator;
} header;
char *timespec;
} data;
unsigned char width;
unsigned char precision;
enum log_quote quote:3;
unsigned int left:1;
unsigned int space:1;
unsigned int zero:1;
int divisor;
logformat_token *next; /* todo: move from linked list to array */
};

struct logformat_token_table_entry {
const char *config;
logformat_bcode_t token_type;
int options;
};

struct logformat_token_table_entry logformat_token_table[] =
{

{">a", LFT_CLIENT_IP_ADDRESS},
{">p", LFT_CLIENT_PORT},
{">A", LFT_CLIENT_FQDN},

/*{ "<a", LFT_SERVER_IP_ADDRESS }, */
/*{ "<p", LFT_SERVER_PORT }, */
{"<A", LFT_SERVER_IP_OR_PEER_NAME},

{"la", LFT_LOCAL_IP},
{"lp", LFT_LOCAL_PORT},
/*{ "lA", LFT_LOCAL_NAME }, */

{"ts", LFT_TIME_SECONDS_SINCE_EPOCH},
{"tu", LFT_TIME_SUBSECOND},
{"tl", LFT_TIME_LOCALTIME},
{"tg", LFT_TIME_GMT},
{"tr", LFT_TIME_TO_HANDLE_REQUEST},

{">h", LFT_REQUEST_HEADER},
{">h", LFT_REQUEST_ALL_HEADERS},
{"<h", LFT_REPLY_HEADER},
{"<h", LFT_REPLY_ALL_HEADERS},

{"un", LFT_USER_NAME},
{"ul", LFT_USER_LOGIN},
/*{ "ur", LFT_USER_REALM }, */
/*{ "us", LFT_USER_SCHEME }, */
{"ui", LFT_USER_IDENT},
#if USE_SSL
{"us", LFT_USER_SSL},
#endif
{"ue", LFT_USER_EXT},

{"Hs", LFT_HTTP_CODE},
/*{ "Ht", LFT_HTTP_STATUS }, */

{"Ss", LFT_SQUID_STATUS},
/*{ "Se", LFT_SQUID_ERROR }, */
{"Sh", LFT_SQUID_HIERARCHY},

{"mt", LFT_MIME_TYPE},

{"rm", LFT_REQUEST_METHOD},
{"ru", LFT_REQUEST_URI}, /* doesn't include the query-string */
/* { "rq", LFT_REQUEST_QUERY }, * / / * the query-string, INCLUDING the leading ? */
{">v", LFT_REQUEST_VERSION},
{"rv", LFT_REQUEST_VERSION},

{">st", LFT_REQUEST_SIZE_TOTAL},
/*{ ">sl", LFT_REQUEST_SIZE_LINE }, * / / * the request line "GET ... " */
/*{ ">sh", LFT_REQUEST_SIZE_HEADERS }, */
/*{ ">sb", LFT_REQUEST_SIZE_BODY }, */
/*{ ">sB", LFT_REQUEST_SIZE_BODY_NO_TE }, */

{"<st", LFT_REPLY_SIZE_TOTAL},
/*{ "<sl", LFT_REPLY_SIZE_LINE }, * / / * the reply line (protocol, code, text) */
/*{ "<sh", LFT_REPLY_SIZE_HEADERS }, */
/*{ "<sb", LFT_REPLY_SIZE_BODY }, */
/*{ "<sB", LFT_REPLY_SIZE_BODY_NO_TE }, */

{"st", LFT_IO_SIZE_TOTAL},

{"ea", LFT_EXT_LOG},

{"%", LFT_PERCENT},

{NULL, LFT_NONE} /* this must be last */
};

static void
accessLogCustom(AccessLogEntry * al, customlog * log)
{
logformat *lf;
Logfile *logfile;
logformat_token *fmt;
static MemBuf mb = MemBufNULL;
char tmp[1024];
String sb = StringNull;

memBufReset(&mb);

lf = log->logFormat;
logfile = log->logfile;
for (fmt = lf->format; fmt != NULL; fmt = fmt->next) { /* for each token */
const char *out = NULL;
int quote = 0;
long int outint = 0;
int doint = 0;
int dofree = 0;
switch (fmt->type) {
case LFT_NONE:
out = "";
break;
case LFT_STRING:
out = fmt->data.string;
break;
case LFT_CLIENT_IP_ADDRESS:
out = inet_ntoa(al->cache.caddr);
break;

case LFT_CLIENT_FQDN:
out = fqdncache_gethostbyaddr(al->cache.caddr, FQDN_LOOKUP_IF_MISS);
if (!out)
out = inet_ntoa(al->cache.caddr);
break;

case LFT_CLIENT_PORT:
if (al->request) {
outint = al->request->client_port;
doint = 1;
}
break;

/* case LFT_SERVER_IP_ADDRESS: */

case LFT_SERVER_IP_OR_PEER_NAME:
out = al->hier.host;
break;

/* case LFT_SERVER_PORT: */

case LFT_LOCAL_IP:
if (al->request)
out = inet_ntoa(al->request->my_addr);
break;

case LFT_LOCAL_PORT:
if (al->request) {
outint = al->request->my_port;
doint = 1;
}
break;

case LFT_TIME_SECONDS_SINCE_EPOCH:
outint = current_time.tv_sec;
doint = 1;
break;

case LFT_TIME_SUBSECOND:
outint = current_time.tv_usec / fmt->divisor;
doint = 1;
break;


case LFT_TIME_LOCALTIME:
case LFT_TIME_GMT:
{
const char *spec;
struct tm *t;
spec = fmt->data.timespec;
if (!spec)
spec = "%d/%b/%Y:%H:%M:%S %z";
if (fmt->type == LFT_TIME_LOCALTIME)
t = localtime(&squid_curtime);
else
t = gmtime(&squid_curtime);
strftime(tmp, sizeof(tmp), spec, t);
out = tmp;
}
break;

case LFT_TIME_TO_HANDLE_REQUEST:
outint = al->cache.msec;
doint = 1;
break;

case LFT_REQUEST_HEADER:
if (al->request)
sb = httpHeaderGetByName(&al->request->header, fmt->data.header.header);
out = strBuf(sb);
quote = 1;
break;

case LFT_REPLY_HEADER:
if (al->reply)
sb = httpHeaderGetByName(&al->reply->header, fmt->data.header.header);
out = strBuf(sb);
quote = 1;
break;

case LFT_REQUEST_HEADER_ELEM:
if (al->request)
sb = httpHeaderGetByNameListMember(&al->request->header, fmt->data.header.header, fmt->data.header.element, fmt->data.header.separator);
out = strBuf(sb);
quote = 1;
break;

case LFT_REPLY_HEADER_ELEM:
if (al->reply)
sb = httpHeaderGetByNameListMember(&al->reply->header, fmt->data.header.header, fmt->data.header.element, fmt->data.header.separator);
out = strBuf(sb);
quote = 1;
break;

case LFT_REQUEST_ALL_HEADERS:
out = al->headers.request;
quote = 1;
break;

case LFT_REPLY_ALL_HEADERS:
out = al->headers.reply;
quote = 1;
break;

case LFT_USER_NAME:
out = al->cache.authuser;
if (!out || !*out)
out = al->cache.rfc931;
#if USE_SSL
if (!out || !*out)
out = al->cache.ssluser;
#endif
quote = 1;
break;

case LFT_USER_LOGIN:
out = al->cache.authuser;
quote = 1;
break;

case LFT_USER_IDENT:
out = al->cache.rfc931;
quote = 1;
break;

/* case LFT_USER_REALM: */
/* case LFT_USER_SCHEME: */

#if USE_SSL
case LFT_USER_SSL:
out = al->cache.ssluser;
quote = 1;
break;
#endif

case LFT_USER_EXT:
if (al->request)
out = strBuf(al->request->extacl_log);
quote = 1;
break;

case LFT_HTTP_CODE:
outint = al->http.code;
doint = 1;
break;

/* case LFT_HTTP_STATUS:
* out = statusline->text;
* quote = 1;
* break;
*/

case LFT_SQUID_STATUS:
out = log_tags[al->cache.code];
break;

/* case LFT_SQUID_ERROR: */

case LFT_SQUID_HIERARCHY:
if (al->hier.ping.timedout)
memBufAppend(&mb, "TIMEOUT_", 8);
out = hier_strings[al->hier.code];
break;

case LFT_MIME_TYPE:
out = al->http.content_type;
break;

case LFT_REQUEST_METHOD:
out = al->private.method_str;
break;

case LFT_REQUEST_URI:
out = al->url;
break;

case LFT_REQUEST_VERSION:
snprintf(tmp, sizeof(tmp), "%d.%d", (int) al->http.version.major, (int) al->http.version.minor);
out = tmp;
break;

case LFT_REQUEST_SIZE_TOTAL:
outint = al->cache.rq_size;
doint = 1;
break;
/*case LFT_REQUEST_SIZE_LINE: */
/*case LFT_REQUEST_SIZE_HEADERS: */
/*case LFT_REQUEST_SIZE_BODY: */
/*case LFT_REQUEST_SIZE_BODY_NO_TE: */

case LFT_REPLY_SIZE_TOTAL:
outint = al->cache.size;
doint = 1;
break;

/*case LFT_REPLY_SIZE_LINE: */
/*case LFT_REPLY_SIZE_HEADERS: */
/*case LFT_REPLY_SIZE_BODY: */
/*case LFT_REPLY_SIZE_BODY_NO_TE: */

case LFT_IO_SIZE_TOTAL:
outint = al->cache.size + al->cache.rq_size;
doint = 1;
break;

case LFT_EXT_LOG:
if (al->request)
out = strBuf(al->request->extacl_log);

quote = 1;
break;

case LFT_PERCENT:
out = "%";
break;
}

if (doint) {
snprintf(tmp, sizeof(tmp), "%0*ld", fmt->zero ? (int) fmt->width : 0, outint);
out = tmp;
}
if (out && *out) {
if (quote || fmt->quote != LOG_QUOTE_NONE) {
char *newout = NULL;
int newfree = 0;
switch (fmt->quote) {
case LOG_QUOTE_NONE:
newout = rfc1738_escape_unescaped(out);
break;
case LOG_QUOTE_QUOTES:
newout = log_quoted_string(out);
newfree = 1;
break;
case LOG_QUOTE_BRAKETS:
newout = log_quote(out);
newfree = 1;
break;
case LOG_QUOTE_URL:
newout = rfc1738_escape(out);
break;
case LOG_QUOTE_RAW:
break;
}
if (newout) {
if (dofree)
safe_free(out);
out = newout;
dofree = newfree;
}
}
if (fmt->width) {
if (fmt->left)
memBufPrintf(&mb, "%-*s", (int) fmt->width, out);
else
memBufPrintf(&mb, "%*s", (int) fmt->width, out);
} else
memBufAppend(&mb, out, strlen(out));
} else {
memBufAppend(&mb, "-", 1);
}
if (fmt->space)
memBufAppend(&mb, " ", 1);
stringClean(&sb);
if (dofree)
safe_free(out);
}
logfilePrintf(logfile, "%s\n", mb.buf);
}

/* parses a single token. Returns the token length in characters,
* and fills in the lt item with the token information.
* def is for sure null-terminated
*/
static int
accessLogGetNewLogFormatToken(logformat_token * lt, char *def, enum log_quote *quote)
{
char *cur = def;
struct logformat_token_table_entry *lte;
int l;

memset(lt, 0, sizeof(*lt));
l = strcspn(cur, "%");
if (l > 0) {
char *cp;
/* it's a string for sure, until {COMENTARIO} or the next % */
cp = xmalloc(l + 1);
xstrncpy(cp, cur, l + 1);
lt->type = LFT_STRING;
lt->data.string = cp;
while (l > 0) {
switch (*cur) {
case '"':
if (*quote == LOG_QUOTE_NONE)
*quote = LOG_QUOTE_QUOTES;
else if (*quote == LOG_QUOTE_QUOTES)
*quote = LOG_QUOTE_NONE;
break;
case '[':
if (*quote == LOG_QUOTE_NONE)
*quote = LOG_QUOTE_BRAKETS;
break;
case ']':
if (*quote == LOG_QUOTE_BRAKETS)
*quote = LOG_QUOTE_NONE;
break;
}
cur++;
l--;
}
goto done;
}
if (!*cur)
goto done;
cur++;
switch (*cur) {
case '"':
lt->quote = LOG_QUOTE_QUOTES;
cur++;
break;
case '\'':
lt->quote = LOG_QUOTE_RAW;
cur++;
break;
case '[':
lt->quote = LOG_QUOTE_BRAKETS;
cur++;
break;
case '#':
lt->quote = LOG_QUOTE_URL;
cur++;
break;
default:
lt->quote = *quote;
break;
}
if (*cur == '-') {
lt->left = 1;
cur++;
}
if (*cur == '0') {
lt->zero = 1;
cur++;
}
if (xisdigit(*cur))
lt->width = strtol(cur, &cur, 10);
if (*cur == '.')
lt->precision = strtol(cur + 1, &cur, 10);
if (*cur == '{') {
char *cp;
cur++;
l = strcspn(cur, "}");
cp = xmalloc(l + 1);
xstrncpy(cp, cur, l + 1);
lt->data.string = cp;
cur += l;
if (*cur == '}')
cur++;
}
lt->type = LFT_NONE;
for (lte = logformat_token_table; lte->config != NULL; lte++) {
if (strncmp(lte->config, cur, strlen(lte->config)) == 0) {
lt->type = lte->token_type;
cur += strlen(lte->config);
break;
}
}
if (lt->type == LFT_NONE) {
fatalf("Can't parse configuration token: '%s'\n",
def);
}
if (*cur == ' ') {
lt->space = 1;
cur++;
}
done:
switch (lt->type) {
case LFT_REQUEST_HEADER:
case LFT_REPLY_HEADER:
if (lt->data.string) {
char *header = lt->data.string;
char *cp = strchr(header, ':');
if (cp) {
*cp++ = '{COMENTARIO}';
if (*cp == ',' || *cp == ';' || *cp == ':')
lt->data.header.separator = *cp++;
else
lt->data.header.separator = ',';
lt->data.header.element = cp;
lt->type = (lt->type == LFT_REQUEST_HEADER) ?
LFT_REQUEST_HEADER_ELEM :
LFT_REPLY_HEADER_ELEM;
}
lt->data.header.header = header;
} else {
lt->type = (lt->type == LFT_REQUEST_HEADER) ?
LFT_REQUEST_ALL_HEADERS :
LFT_REPLY_ALL_HEADERS;
Config.onoff.log_mime_hdrs = 1;
}
break;
case LFT_CLIENT_FQDN:
Config.onoff.log_fqdn = 1;
break;
case LFT_TIME_SUBSECOND:
lt->divisor = 1000;
if (lt->precision) {
int i;
lt->divisor = 1000000;
for (i = lt->precision; i > 1; i--)
lt->divisor /= 10;
if (!lt->divisor)
lt->divisor = 0;
}
break;
default:
break;
}
return (cur - def);
}

int
accessLogParseLogFormat(logformat_token ** fmt, char *def)
{
char *cur, *eos;
logformat_token *new_lt, *last_lt;
enum log_quote quote = LOG_QUOTE_NONE;

debug(46, 1) ("accessLogParseLogFormat: got definition '%s'\n", def);

/* very inefficent parser, but who cares, this needs to be simple */
/* First off, let's tokenize, we'll optimize in a second pass.
* A token can either be a %-prefixed sequence (usually a dynamic
* token but it can be an escaped sequence), or a string. */
cur = def;
eos = def + strlen(def);
*fmt = new_lt = last_lt = xmalloc(sizeof(logformat_token));
cur += accessLogGetNewLogFormatToken(new_lt, cur, "e);
while (cur < eos) {
new_lt = xmalloc(sizeof(logformat_token));
last_lt->next = new_lt;
last_lt = new_lt;
cur += accessLogGetNewLogFormatToken(new_lt, cur, "e);
}
return 1;
}

void
accessLogDumpLogFormat(StoreEntry * entry, const char *name, logformat * definitions)
{
logformat_token *t;
logformat *format;
struct logformat_token_table_entry *te;
debug(46, 4) ("accessLogDumpLogFormat called\n");

for (format = definitions; format; format = format->next) {
debug(46, 4) ("Dumping logformat definition for %s\n", format->name);
storeAppendPrintf(entry, "logformat %s ", format->name);
for (t = format->format; t; t = t->next) {
if (t->type == LFT_STRING)
storeAppendPrintf(entry, "%s", t->data.string);
else {
char argbuf[256];
char *arg = NULL;
logformat_bcode_t type = t->type;

switch (type) {
/* special cases */
case LFT_STRING:
break;
case LFT_REQUEST_HEADER_ELEM:
case LFT_REPLY_HEADER_ELEM:
if (t->data.header.separator != ',')
snprintf(argbuf, sizeof(argbuf), "%s:%c%s", t->data.header.header, t->data.header.separator, t->data.header.element);
else
snprintf(argbuf, sizeof(argbuf), "%s:%s", t->data.header.header, t->data.header.element);

arg = argbuf;
type = (type == LFT_REQUEST_HEADER_ELEM) ?
LFT_REQUEST_HEADER :
LFT_REPLY_HEADER;
break;

case LFT_REQUEST_ALL_HEADERS:
case LFT_REPLY_ALL_HEADERS:
type = (type == LFT_REQUEST_ALL_HEADERS) ?
LFT_REQUEST_HEADER :
LFT_REPLY_HEADER;
break;

default:
if (t->data.string)
arg = t->data.string;
break;
}
storeAppend(entry, "%", 1);
switch (t->quote) {
case LOG_QUOTE_QUOTES:
storeAppend(entry, "\"", 1);
break;
case LOG_QUOTE_BRAKETS:
storeAppend(entry, "[", 1);
break;
case LOG_QUOTE_URL:
storeAppend(entry, "#", 1);
break;
case LOG_QUOTE_RAW:
storeAppend(entry, "'", 1);
break;
case LOG_QUOTE_NONE:
break;
}
if (t->left)
storeAppend(entry, "-", 1);
if (t->zero)
storeAppend(entry, "0", 1);
if (t->width)
storeAppendPrintf(entry, "%d", (int) t->width);
if (t->precision)
storeAppendPrintf(entry, ".%d", (int) t->precision);
if (arg)
storeAppendPrintf(entry, "{%s}", arg);
for (te = logformat_token_table; te->config != NULL; te++) {
if (te->token_type == t->type) {
storeAppendPrintf(entry, "%s", te->config);
break;
}
}
if (t->space)
storeAppend(entry, " ", 1);
assert(te->config != NULL);
}
}
storeAppend(entry, "\n", 1);
}
}

void
accessLogFreeLogFormat(logformat_token ** tokens)
{
while (*tokens) {
logformat_token *token = *tokens;
*tokens = token->next;
safe_free(token->data.string);
xfree(token);
}
}

static void
accessLogSquid(AccessLogEntry * al, Logfile * logfile)
{
const char *client = NULL;
const char *user = NULL;
if (Config.onoff.log_fqdn)
client = fqdncache_gethostbyaddr(al->cache.caddr, FQDN_LOOKUP_IF_MISS);
if (client == NULL)
client = inet_ntoa(al->cache.caddr);
user = accessLogFormatName(al->cache.authuser);
if (!user)
user = accessLogFormatName(al->cache.rfc931);
#if USE_SSL
if (!user)
user = accessLogFormatName(al->cache.ssluser);
#endif
if (user && !*user)
safe_free(user);
if (!Config.onoff.log_mime_hdrs) {
strcpy(insertSQL,"INSERT INTO logSquid( date, clientIP, tags_HIT_MISS, http_code, cache_size, private_method_str,
strcat(insertSQL,client);
strcat(insertSQL,"','");
strcat(insertSQL,log_tags[al->cache.code]);
strcat(insertSQL,"','");
snprintf(intconvstr,3,"%d",al->http.code);
strcat(insertSQL,intconvstr);
strcat(insertSQL,"','");
snprintf(intconvstr,11,"%d",al->cache.size);
strcat(insertSQL,intconvstr);
strcat(insertSQL,"','");
strcat(insertSQL,al->private.method_str);
strcat(insertSQL,"','");
strcat(insertSQL,al->url);
strcat(insertSQL,"','");
strcat(insertSQL,user ? user : dash_str);
strcat(insertSQL,"');");

mysql_init(&conexao);
if ( mysql_real_connect(&conexao, "localhost", "proxy", "proxy", "proxy", 0, NULL, 0) )
{
res = mysql_query(&conexao,insertSQL);
if (res)
logfilePrintf(logfile,"Erro na inserção %d : %s\n%s", mysql_errno(&conexao), mysql_error(&conexao),insertSQL)
mysql_close(&conexao);

}
else
{
logfilePrintf(logfile,"Falha de conexao\n");
logfilePrintf(logfile,"Erro %d : %s\n", mysql_errno(&conexao), mysql_error(&conexao));
}
safe_free(user);
}

static void
accessLogCommon(AccessLogEntry * al, Logfile * logfile)
{
const char *client = NULL;
char *user1 = NULL, *user2 = NULL;
if (Config.onoff.log_fqdn)
client = fqdncache_gethostbyaddr(al->cache.caddr, 0);
if (client == NULL)
client = inet_ntoa(al->cache.caddr);
user1 = accessLogFormatName(al->cache.authuser);
user2 = accessLogFormatName(al->cache.rfc931);
logfilePrintf(logfile, "%s %s %s [%s] \"%s %s HTTP/%d.%d\" %d %" PRINTF_OFF_T " %s:%s",
client,
user2 ? user2 : dash_str,
user1 ? user1 : dash_str,
mkhttpdlogtime(&squid_curtime),
al->private.method_str,
al->url,
al->http.version.major, al->http.version.minor,
al->http.code,
al->cache.size,
log_tags[al->cache.code],
hier_strings[al->hier.code]);
safe_free(user1);
safe_free(user2);
if (Config.onoff.log_mime_hdrs) {
char *ereq = log_quote(al->headers.request);
char *erep = log_quote(al->headers.reply);
logfilePrintf(logfile, " [%s] [%s]\n", ereq, erep);
safe_free(ereq);
safe_free(erep);
} else {
logfilePrintf(logfile, "\n");
}
}

void
accessLogLog(AccessLogEntry * al, aclCheck_t * checklist)
{
customlog *log;
if (LogfileStatus != LOG_ENABLE)
return;
if (al->url == NULL)
al->url = dash_str;
if (!al->http.content_type || *al->http.content_type == '{COMENTARIO}')
al->http.content_type = dash_str;
if (al->icp.opcode)
al->private.method_str = icp_opcode_str[al->icp.opcode];
else
al->private.method_str = RequestMethodStr[al->http.method];
if (al->hier.host[0] == '{COMENTARIO}')
xstrncpy(al->hier.host, dash_str, SQUIDHOSTNAMELEN);

for (log = Config.Log.accesslogs; log; log = log->next) {
if (checklist && log->aclList && aclMatchAclList(log->aclList, checklist) != 1)
continue;
switch (log->type) {
case CLF_AUTO:
if (Config.onoff.common_log)
accessLogCommon(al, log->logfile);
else
accessLogSquid(al, log->logfile);
break;
case CLF_SQUID:
accessLogSquid(al, log->logfile);
break;
case CLF_COMMON:
accessLogCommon(al, log->logfile);
break;
case CLF_CUSTOM:
accessLogCustom(al, log);
break;
case CLF_NONE:
goto last;
default:
fatalf("Unknown log format %d\n", log->type);
break;
}
logfileFlush(log->logfile);
if (!checklist)
break;
}
last:
(void) 0; /* NULL statement for label */

#if MULTICAST_MISS_STREAM
if (al->cache.code != LOG_TCP_MISS)
(void) 0;
else if (al->http.method != METHOD_GET)
(void) 0;
else if (mcast_miss_fd < 0)
(void) 0;
else {
unsigned int ibuf[365];
size_t isize;
xstrncpy((char *) ibuf, al->url, 364 * sizeof(int));
isize = ((strlen(al->url) + 8) / 8) * 2;
if (isize > 364)
isize = 364;
mcast_encode((unsigned int *) ibuf, isize,
(const unsigned int *) Config.mcast_miss.encode_key);
comm_udp_sendto(mcast_miss_fd,
&mcast_miss_to, sizeof(mcast_miss_to),
ibuf, isize * sizeof(int));
}
#endif
}

void
accessLogRotate(void)
{
customlog *log;
#if FORW_VIA_DB
fvdbClear();
#endif
for (log = Config.Log.accesslogs; log; log = log->next) {
if (log->logfile) {
logfileRotate(log->logfile);
}
}
#if HEADERS_LOG
logfileRotate(headerslog);
#endif
}

void
accessLogClose(void)
{
customlog *log;
for (log = Config.Log.accesslogs; log; log = log->next) {
if (log->logfile) {
logfileClose(log->logfile);
log->logfile = NULL;
}
}
#if HEADERS_LOG
logfileClose(headerslog);
headerslog = NULL;
#endif
}

void
hierarchyNote(HierarchyLogEntry * hl,
hier_code code,
const char *cache_peer)
{
assert(hl != NULL);
hl->code = code;
xstrncpy(hl->host, cache_peer, SQUIDHOSTNAMELEN);
}

void
accessLogInit(void)
{
customlog *log;
for (log = Config.Log.accesslogs; log; log = log->next) {
if (log->type == CLF_NONE)
continue;
log->logfile = logfileOpen(log->filename, MAX_URL << 1, 1);
LogfileStatus = LOG_ENABLE;
}
#if HEADERS_LOG
headerslog = logfileOpen("/var/log/squid/headers.log", MAX_URL << 1, 0);
assert(NULL != headerslog);
#endif
#if FORW_VIA_DB
fvdbInit();
#endif
#if MULTICAST_MISS_STREAM
if (Config.mcast_miss.addr.s_addr != no_addr.s_addr) {
memset(&mcast_miss_to, '{COMENTARIO}', sizeof(mcast_miss_to));
mcast_miss_to.sin_family = AF_INET;
mcast_miss_to.sin_port = htons(Config.mcast_miss.port);
mcast_miss_to.sin_addr.s_addr = Config.mcast_miss.addr.s_addr;
mcast_miss_fd = comm_open(SOCK_DGRAM,
IPPROTO_UDP,
Config.Addrs.udp_incoming,
Config.mcast_miss.port,
COMM_NONBLOCKING,
"Multicast Miss Stream");
if (mcast_miss_fd < 0)
fatal("Cannot open Multicast Miss Stream Socket");
debug(46, 1) ("Multicast Miss Stream Socket opened on FD %d\n",
mcast_miss_fd);
mcastSetTtl(mcast_miss_fd, Config.mcast_miss.ttl);
if (strlen(Config.mcast_miss.encode_key) < 16)
fatal("mcast_encode_key is too short, must be 16 characters");
}
#endif
}

const char *
accessLogTime(time_t t)
{
struct tm *tm;
static char buf[128];
static time_t last_t = 0;
if (t != last_t) {
tm = localtime(&t);
strftime(buf, 127, "%Y/%m/%d %H:%M:%S", tm);
last_t = t;
}
return buf;
}


#if FORW_VIA_DB

static void
fvdbInit(void)
{
via_table = hash_create((HASHCMP *) strcmp, 977, hash4);
forw_table = hash_create((HASHCMP *) strcmp, 977, hash4);
cachemgrRegister("via_headers", "Via Request Headers", fvdbDumpVia, 0, 1);
cachemgrRegister("forw_headers", "X-Forwarded-For Request Headers",
fvdbDumpForw, 0, 1);
}

static void
fvdbCount(hash_table * hash, const char *key)
{
fvdb_entry *fv;
if (NULL == hash)
return;
fv = hash_lookup(hash, key);
if (NULL == fv) {
fv = xcalloc(1, sizeof(fvdb_entry));
fv->hash.key = xstrdup(key);
hash_join(hash, &fv->hash);
}
fv->n++;
}

void
fvdbCountVia(const char *key)
{
fvdbCount(via_table, key);
}

void
fvdbCountForw(const char *key)
{
fvdbCount(forw_table, key);
}

static void
fvdbDumpTable(StoreEntry * e, hash_table * hash)
{
hash_link *h;
fvdb_entry *fv;
if (hash == NULL)
return;
hash_first(hash);
while ((h = hash_next(hash))) {
fv = (fvdb_entry *) h;
storeAppendPrintf(e, "%9d %s\n", fv->n, hashKeyStr(&fv->hash));
}
}

static void
fvdbDumpVia(StoreEntry * e)
{
fvdbDumpTable(e, via_table);
}

static void
fvdbDumpForw(StoreEntry * e)
{
fvdbDumpTable(e, forw_table);
}

static
void
fvdbFreeEntry(void *data)
{
fvdb_entry *fv = data;
xfree(fv->hash.key);
xfree(fv);
}

static void
fvdbClear(void)
{
hashFreeItems(via_table, fvdbFreeEntry);
hashFreeMemory(via_table);
via_table = hash_create((HASHCMP *) strcmp, 977, hash4);
hashFreeItems(forw_table, fvdbFreeEntry);
hashFreeMemory(forw_table);
forw_table = hash_create((HASHCMP *) strcmp, 977, hash4);
}

#endif

#if MULTICAST_MISS_STREAM
/*
* From http://www.io.com/~paulhart/game/algorithms/tea.html
*
* size of 'ibuf' must be a multiple of 2.
* size of 'key' must be 4.
* 'ibuf' is modified in place, encrypted data is written in
* network byte order.
*/
static void
mcast_encode(unsigned int *ibuf, size_t isize, const unsigned int *key)
{
unsigned int y;
unsigned int z;
unsigned int sum;
const unsigned int delta = 0x9e3779b9;
unsigned int n = 32;
const unsigned int k0 = htonl(key[0]);
const unsigned int k1 = htonl(key[1]);
const unsigned int k2 = htonl(key[2]);
const unsigned int k3 = htonl(key[3]);
int i;
for (i = 0; i < isize; i += 2) {
y = htonl(ibuf[i]);
z = htonl(ibuf[i + 1]);
sum = 0;
for (n = 32; n; n--) {
sum += delta;
y += (z << 4) + (k0 ^ z) + (sum ^ (z >> 5)) + k1;
z += (y << 4) + (k2 ^ y) + (sum ^ (y >> 5)) + k3;
}
ibuf[i] = htonl(y);
ibuf[i + 1] = htonl(z);
}
}

#endif

#if HEADERS_LOG
void
headersLog(int cs, int pq, method_t m, void *data)
{
HttpReply *rep;
request_t *req;
unsigned short magic = 0;
unsigned char M = (unsigned char) m;
unsigned short S;
char *hmask;
int ccmask = 0;
if (0 == pq) {
/* reply */
rep = data;
req = NULL;
magic = 0x0050;
hmask = rep->header.mask;
if (rep->cache_control)
ccmask = rep->cache_control->mask;
} else {
/* request */
req = data;
rep = NULL;
magic = 0x0051;
hmask = req->header.mask;
if (req->cache_control)
ccmask = req->cache_control->mask;
}
if (0 == cs) {
/* client */
magic |= 0x4300;
} else {
/* server */
magic |= 0x5300;
}
magic = htons(magic);
ccmask = htonl(ccmask);
if (0 == pq)
S = (unsigned short) rep->sline.status;
else
S = (unsigned short) HTTP_STATUS_NONE;
logfileWrite(headerslog, &magic, sizeof(magic));
logfileWrite(headerslog, &M, sizeof(M));
logfileWrite(headerslog, &S, sizeof(S));
logfileWrite(headerslog, hmask, sizeof(HttpHeaderMask));
logfileWrite(headerslog, &ccmask, sizeof(int));
logfileFlush(headerslog);
}

#endif

[8] Comentário enviado por m@verick em 17/12/2007 - 00:23h

Balani, tudo OK, desculpe a demora na resposta é que as coisas andam meio corridas de um olhada nestre trecho do código eu postei faltando um parenteses e uma aspas observe logo depois desta palavra private_method_str

f (!Config.onoff.log_mime_hdrs) {
strcpy(insertSQL,"INSERT INTO logSquid( date, clientIP, tags_HIT_MISS, http_code, cache_size, private_method_str"),

isto ja deve resolver, se não entre em contato novamente.

[9] Comentário enviado por balani em 17/12/2007 - 09:23h

Bom dia amigo, muito obrigado pela atenção, a sua dica resolveu aquele problema, me desculpe, mais não entendo muito de programação C, e está apresentando o seguinte erro agora:

access_log.c: In function 'accessLogSquid':
access_log.c:1067: error: invalid storage class for function 'accessLogCommon'
access_log.c:1268: error: expected declaration or statement at end of input


Se vc puder quebrar mais esse galho, eu agradeço desde já.

[10] Comentário enviado por m@verick em 08/01/2008 - 21:00h

Balani, depois destas férias só pude responder agora, segue abaixo o codigo que compilei e posso dizer que funciona.


/*
* $Id: access_log.c,v 1.95.2.2 2007/06/03 00:40:32 hno Exp $
*
* DEBUG: section 46 Access Log
* AUTHOR: Duane Wessels
*
* SQUID Web Proxy Cache http://www.squid-cache.org/
* ----------------------------------------------------------
*
* Squid is the result of efforts by numerous individuals from
* the Internet community; see the CONTRIBUTORS file for full
* details. Many organizations have provided support for Squid's
* development; see the SPONSORS file for full details. Squid is
* Copyrighted (C) 2001 by the Regents of the University of
* California; see the COPYRIGHT file for full details. Squid
* incorporates software developed and/or copyrighted by other
* sources; see the CREDITS file for full details.
*
* This program is free software; you can redistribute it and/or modify
* it under the terms of the GNU General Public License as published by
* the Free Software Foundation; either version 2 of the License, or
* (at your option) any later version.
*
* This program is distributed in the hope that it will be useful,
* but WITHOUT ANY WARRANTY; without even the implied warranty of
* MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
* GNU General Public License for more details.
*
* You should have received a copy of the GNU General Public License
* along with this program; if not, write to the Free Software
* Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA 02111, USA.
*
*/


#include "squid.h"
#include <mysql/mysql.h>
#include <stdlib.h>
#include <stdio.h>

char insertSQL[400];
char intconvstr[5];
int res;
MYSQL conexao;

#if HEADERS_LOG
static Logfile *headerslog = NULL;
#endif

#if MULTICAST_MISS_STREAM
static int mcast_miss_fd = -1;
static struct sockaddr_in mcast_miss_to;
static void mcast_encode(unsigned int *, size_t, const unsigned int *);
#endif

#if FORW_VIA_DB
typedef struct {
hash_link hash;
int n;
} fvdb_entry;
static hash_table *via_table = NULL;
static hash_table *forw_table = NULL;
static void fvdbInit(void);
static void fvdbDumpTable(StoreEntry * e, hash_table * hash);
static void fvdbCount(hash_table * hash, const char *key);
static OBJH fvdbDumpVia;
static OBJH fvdbDumpForw;
static FREE fvdbFreeEntry;
static void fvdbClear(void);
#endif

static int LogfileStatus = LOG_DISABLE;
#define LOG_BUF_SZ (MAX_URL<<2)

static const char c2x[] =
"000102030405060708090a0b0c0d0e0f"
"101112131415161718191a1b1c1d1e1f"
"202122232425262728292a2b2c2d2e2f"
"303132333435363738393a3b3c3d3e3f"
"404142434445464748494a4b4c4d4e4f"
"505152535455565758595a5b5c5d5e5f"
"606162636465666768696a6b6c6d6e6f"
"707172737475767778797a7b7c7d7e7f"
"808182838485868788898a8b8c8d8e8f"
"909192939495969798999a9b9c9d9e9f"
"a0a1a2a3a4a5a6a7a8a9aaabacadaeaf"
"b0b1b2b3b4b5b6b7b8b9babbbcbdbebf"
"c0c1c2c3c4c5c6c7c8c9cacbcccdcecf"
"d0d1d2d3d4d5d6d7d8d9dadbdcdddedf"
"e0e1e2e3e4e5e6e7e8e9eaebecedeeef"
"f0f1f2f3f4f5f6f7f8f9fafbfcfdfeff";


/* log_quote -- URL-style encoding on MIME headers. */

char *
log_quote(const char *header)
{
int c;
int i;
char *buf;
char *buf_cursor;
if (header == NULL) {
buf = xcalloc(1, 1);
*buf = '{COMENTARIO}';
return buf;
}
buf = xcalloc(1, (strlen(header) * 3) + 1);
buf_cursor = buf;
/*
* We escape: \x00-\x1F"#%;<>?{}|\\\\^~`\[\]\x7F-\xFF
* which is the default escape list for the CPAN Perl5 URI module
* modulo the inclusion of space (x40) to make the raw logs a bit
* more readable.
*/
while ((c = *(const unsigned char *) header++) != '{COMENTARIO}') {
#if !OLD_LOG_MIME
if (c == '\r') {
*buf_cursor++ = '\\';
*buf_cursor++ = 'r';
} else if (c == '\n') {
*buf_cursor++ = '\\';
*buf_cursor++ = 'n';
} else
#endif
if (c <= 0x1F
|| c >= 0x7F
|| c == '%'
#if OLD_LOG_MIME
|| c == '"'
|| c == '#'
|| c == ';'
|| c == '<'
|| c == '>'
|| c == '?'
|| c == '{'
|| c == '}'
|| c == '|'
|| c == '\\'
|| c == '^'
|| c == '~'
|| c == '`'
#endif
|| c == '['
|| c == ']') {
*buf_cursor++ = '%';
i = c * 2;
*buf_cursor++ = c2x[i];
*buf_cursor++ = c2x[i + 1];
#if !OLD_LOG_MIME
} else if (c == '\\') {
*buf_cursor++ = '\\';
*buf_cursor++ = '\\';
#endif
} else {
*buf_cursor++ = (char) c;
}
}
*buf_cursor = '{COMENTARIO}';
return buf;
}

static char *
username_quote(const char *header)
/* copy of log_quote. Bugs there will be found here */
{
int c;
int i;
char *buf;
char *buf_cursor;
if (header == NULL) {
buf = xcalloc(1, 1);
*buf = '{COMENTARIO}';
return buf;
}
buf = xcalloc(1, (strlen(header) * 3) + 1);
buf_cursor = buf;
/*
* We escape: space \x00-\x1F and space (0x40) and \x7F-\xFF
* to prevent garbage in the logs. CR and LF are also there just in case.
*/
while ((c = *(const unsigned char *) header++) != '{COMENTARIO}') {
if (c == '\r') {
*buf_cursor++ = '\\';
*buf_cursor++ = 'r';
} else if (c == '\n') {
*buf_cursor++ = '\\';
*buf_cursor++ = 'n';
} else if (c <= 0x1F
|| c >= 0x7F
|| c == '%'
|| c == ' ') {
*buf_cursor++ = '%';
i = c * 2;
*buf_cursor++ = c2x[i];
*buf_cursor++ = c2x[i + 1];
} else {
*buf_cursor++ = (char) c;
}
}
*buf_cursor = '{COMENTARIO}';
return buf;
}

static char *
accessLogFormatName(const char *name)
{
if (NULL == name)
return NULL;
if (name[0] == '{COMENTARIO}')
return NULL;
return username_quote(name);
}

static char *
log_quoted_string(const char *str)
{
char *out = xmalloc(strlen(str) * 2 + 1);
char *p = out;
while (*str) {
int l = strcspn(str, "\"\\\r\n\t");
memcpy(p, str, l);
str += l;
p += l;
switch (*str) {
case '{COMENTARIO}':
break;
case '\r':
*p++ = '\\';
*p++ = 'r';
str++;
break;
case '\n':
*p++ = '\\';
*p++ = 'n';
str++;
break;
case '\t':
*p++ = '\\';
*p++ = 't';
str++;
break;
default:
*p++ = '\\';
*p++ = *str;
str++;
break;
}
}
*p++ = '{COMENTARIO}';
return out;
}

/*
* Bytecodes for the configureable logformat stuff
*/
typedef enum {
LFT_NONE, /* dummy */
LFT_STRING,

LFT_CLIENT_IP_ADDRESS,
LFT_CLIENT_FQDN,
LFT_CLIENT_PORT,

/*LFT_SERVER_IP_ADDRESS, */
LFT_SERVER_IP_OR_PEER_NAME,
/*LFT_SERVER_PORT, */

LFT_LOCAL_IP,
LFT_LOCAL_PORT,
/*LFT_LOCAL_NAME, */

LFT_TIME_SECONDS_SINCE_EPOCH,
LFT_TIME_SUBSECOND,
LFT_TIME_LOCALTIME,
LFT_TIME_GMT,
LFT_TIME_TO_HANDLE_REQUEST,

LFT_REQUEST_HEADER,
LFT_REQUEST_HEADER_ELEM,
LFT_REQUEST_ALL_HEADERS,

LFT_REPLY_HEADER,
LFT_REPLY_HEADER_ELEM,
LFT_REPLY_ALL_HEADERS,

LFT_USER_NAME,
LFT_USER_LOGIN,
/*LFT_USER_REALM, */
/*LFT_USER_SCHEME, */
LFT_USER_IDENT,
LFT_USER_EXT,
#if USE_SSL
LFT_USER_SSL,
#endif

LFT_HTTP_CODE,
/*LFT_HTTP_STATUS, */

LFT_SQUID_STATUS,
/*LFT_SQUID_ERROR, */
LFT_SQUID_HIERARCHY,

LFT_MIME_TYPE,

LFT_REQUEST_METHOD,
LFT_REQUEST_URI,
/*LFT_REQUEST_QUERY, * // * this is not needed. see strip_query_terms */
LFT_REQUEST_VERSION,

LFT_REQUEST_SIZE_TOTAL,
/*LFT_REQUEST_SIZE_LINE, */
/*LFT_REQUEST_SIZE_HEADERS, */
/*LFT_REQUEST_SIZE_BODY, */
/*LFT_REQUEST_SIZE_BODY_NO_TE, */

LFT_REPLY_SIZE_TOTAL,
/*LFT_REPLY_SIZE_LINE, */
/*LFT_REPLY_SIZE_HEADERS, */
/*LFT_REPLY_SIZE_BODY, */
/*LFT_REPLY_SIZE_BODY_NO_TE, */

LFT_IO_SIZE_TOTAL,

LFT_EXT_LOG,

LFT_PERCENT /* special string cases for escaped chars */
} logformat_bcode_t;

enum log_quote {
LOG_QUOTE_NONE = 0,
LOG_QUOTE_QUOTES,
LOG_QUOTE_BRAKETS,
LOG_QUOTE_URL,
LOG_QUOTE_RAW
};
struct _logformat_token {
logformat_bcode_t type;
union {
char *string;
struct {
char *header;
char *element;
char separator;
} header;
char *timespec;
} data;
unsigned char width;
unsigned char precision;
enum log_quote quote:3;
unsigned int left:1;
unsigned int space:1;
unsigned int zero:1;
int divisor;
logformat_token *next; /* todo: move from linked list to array */
};

struct logformat_token_table_entry {
const char *config;
logformat_bcode_t token_type;
int options;
};

struct logformat_token_table_entry logformat_token_table[] =
{

{">a", LFT_CLIENT_IP_ADDRESS},
{">p", LFT_CLIENT_PORT},
{">A", LFT_CLIENT_FQDN},

/*{ "<a", LFT_SERVER_IP_ADDRESS }, */
/*{ "<p", LFT_SERVER_PORT }, */
{"<A", LFT_SERVER_IP_OR_PEER_NAME},

{"la", LFT_LOCAL_IP},
{"lp", LFT_LOCAL_PORT},
/*{ "lA", LFT_LOCAL_NAME }, */

{"ts", LFT_TIME_SECONDS_SINCE_EPOCH},
{"tu", LFT_TIME_SUBSECOND},
{"tl", LFT_TIME_LOCALTIME},
{"tg", LFT_TIME_GMT},
{"tr", LFT_TIME_TO_HANDLE_REQUEST},

{">h", LFT_REQUEST_HEADER},
{">h", LFT_REQUEST_ALL_HEADERS},
{"<h", LFT_REPLY_HEADER},
{"<h", LFT_REPLY_ALL_HEADERS},

{"un", LFT_USER_NAME},
{"ul", LFT_USER_LOGIN},
/*{ "ur", LFT_USER_REALM }, */
/*{ "us", LFT_USER_SCHEME }, */
{"ui", LFT_USER_IDENT},
#if USE_SSL
{"us", LFT_USER_SSL},
#endif
{"ue", LFT_USER_EXT},

{"Hs", LFT_HTTP_CODE},
/*{ "Ht", LFT_HTTP_STATUS }, */

{"Ss", LFT_SQUID_STATUS},
/*{ "Se", LFT_SQUID_ERROR }, */
{"Sh", LFT_SQUID_HIERARCHY},

{"mt", LFT_MIME_TYPE},

{"rm", LFT_REQUEST_METHOD},
{"ru", LFT_REQUEST_URI}, /* doesn't include the query-string */
/* { "rq", LFT_REQUEST_QUERY }, * / / * the query-string, INCLUDING the leading ? */
{">v", LFT_REQUEST_VERSION},
{"rv", LFT_REQUEST_VERSION},

{">st", LFT_REQUEST_SIZE_TOTAL},
/*{ ">sl", LFT_REQUEST_SIZE_LINE }, * / / * the request line "GET ... " */
/*{ ">sh", LFT_REQUEST_SIZE_HEADERS }, */
/*{ ">sb", LFT_REQUEST_SIZE_BODY }, */
/*{ ">sB", LFT_REQUEST_SIZE_BODY_NO_TE }, */

{"<st", LFT_REPLY_SIZE_TOTAL},
/*{ "<sl", LFT_REPLY_SIZE_LINE }, * / / * the reply line (protocol, code, text) */
/*{ "<sh", LFT_REPLY_SIZE_HEADERS }, */
/*{ "<sb", LFT_REPLY_SIZE_BODY }, */
/*{ "<sB", LFT_REPLY_SIZE_BODY_NO_TE }, */

{"st", LFT_IO_SIZE_TOTAL},

{"ea", LFT_EXT_LOG},

{"%", LFT_PERCENT},

{NULL, LFT_NONE} /* this must be last */
};

static void
accessLogCustom(AccessLogEntry * al, customlog * log)
{
logformat *lf;
Logfile *logfile;
logformat_token *fmt;
static MemBuf mb = MemBufNULL;
char tmp[1024];
String sb = StringNull;

memBufReset(&mb);

lf = log->logFormat;
logfile = log->logfile;
for (fmt = lf->format; fmt != NULL; fmt = fmt->next) { /* for each token */
const char *out = NULL;
int quote = 0;
long int outint = 0;
int doint = 0;
int dofree = 0;
switch (fmt->type) {
case LFT_NONE:
out = "";
break;
case LFT_STRING:
out = fmt->data.string;
break;
case LFT_CLIENT_IP_ADDRESS:
out = inet_ntoa(al->cache.caddr);
break;

case LFT_CLIENT_FQDN:
out = fqdncache_gethostbyaddr(al->cache.caddr, FQDN_LOOKUP_IF_MISS);
if (!out)
out = inet_ntoa(al->cache.caddr);
break;

case LFT_CLIENT_PORT:
if (al->request) {
outint = al->request->client_port;
doint = 1;
}
break;

/* case LFT_SERVER_IP_ADDRESS: */

case LFT_SERVER_IP_OR_PEER_NAME:
out = al->hier.host;
break;

/* case LFT_SERVER_PORT: */

case LFT_LOCAL_IP:
if (al->request)
out = inet_ntoa(al->request->my_addr);
break;

case LFT_LOCAL_PORT:
if (al->request) {
outint = al->request->my_port;
doint = 1;
}
break;

case LFT_TIME_SECONDS_SINCE_EPOCH:
outint = current_time.tv_sec;
doint = 1;
break;

case LFT_TIME_SUBSECOND:
outint = current_time.tv_usec / fmt->divisor;
doint = 1;
break;


case LFT_TIME_LOCALTIME:
case LFT_TIME_GMT:
{
const char *spec;
struct tm *t;
spec = fmt->data.timespec;
if (!spec)
spec = "%d/%b/%Y:%H:%M:%S %z";
if (fmt->type == LFT_TIME_LOCALTIME)
t = localtime(&squid_curtime);
else
t = gmtime(&squid_curtime);
strftime(tmp, sizeof(tmp), spec, t);
out = tmp;
}
break;

case LFT_TIME_TO_HANDLE_REQUEST:
outint = al->cache.msec;
doint = 1;
break;

case LFT_REQUEST_HEADER:
if (al->request)
sb = httpHeaderGetByName(&al->request->header, fmt->data.header.header);
out = strBuf(sb);
quote = 1;
break;

case LFT_REPLY_HEADER:
if (al->reply)
sb = httpHeaderGetByName(&al->reply->header, fmt->data.header.header);
out = strBuf(sb);
quote = 1;
break;

case LFT_REQUEST_HEADER_ELEM:
if (al->request)
sb = httpHeaderGetByNameListMember(&al->request->header, fmt->data.header.header, fmt->data.header.element, fmt->data.header.separator);
out = strBuf(sb);
quote = 1;
break;

case LFT_REPLY_HEADER_ELEM:
if (al->reply)
sb = httpHeaderGetByNameListMember(&al->reply->header, fmt->data.header.header, fmt->data.header.element, fmt->data.header.separator);
out = strBuf(sb);
quote = 1;
break;

case LFT_REQUEST_ALL_HEADERS:
out = al->headers.request;
quote = 1;
break;

case LFT_REPLY_ALL_HEADERS:
out = al->headers.reply;
quote = 1;
break;

case LFT_USER_NAME:
out = al->cache.authuser;
if (!out || !*out)
out = al->cache.rfc931;
#if USE_SSL
if (!out || !*out)
out = al->cache.ssluser;
#endif
quote = 1;
break;

case LFT_USER_LOGIN:
out = al->cache.authuser;
quote = 1;
break;

case LFT_USER_IDENT:
out = al->cache.rfc931;
quote = 1;
break;

/* case LFT_USER_REALM: */
/* case LFT_USER_SCHEME: */

#if USE_SSL
case LFT_USER_SSL:
out = al->cache.ssluser;
quote = 1;
break;
#endif

case LFT_USER_EXT:
if (al->request)
out = strBuf(al->request->extacl_log);
quote = 1;
break;

case LFT_HTTP_CODE:
outint = al->http.code;
doint = 1;
break;

/* case LFT_HTTP_STATUS:
* out = statusline->text;
* quote = 1;
* break;
*/

case LFT_SQUID_STATUS:
out = log_tags[al->cache.code];
break;

/* case LFT_SQUID_ERROR: */

case LFT_SQUID_HIERARCHY:
if (al->hier.ping.timedout)
memBufAppend(&mb, "TIMEOUT_", 8);
out = hier_strings[al->hier.code];
break;

case LFT_MIME_TYPE:
out = al->http.content_type;
break;

case LFT_REQUEST_METHOD:
out = al->private.method_str;
break;

case LFT_REQUEST_URI:
out = al->url;
break;

case LFT_REQUEST_VERSION:
snprintf(tmp, sizeof(tmp), "%d.%d", (int) al->http.version.major, (int) al->http.version.minor);
out = tmp;
break;

case LFT_REQUEST_SIZE_TOTAL:
outint = al->cache.rq_size;
doint = 1;
break;
/*case LFT_REQUEST_SIZE_LINE: */
/*case LFT_REQUEST_SIZE_HEADERS: */
/*case LFT_REQUEST_SIZE_BODY: */
/*case LFT_REQUEST_SIZE_BODY_NO_TE: */

case LFT_REPLY_SIZE_TOTAL:
outint = al->cache.size;
doint = 1;
break;

/*case LFT_REPLY_SIZE_LINE: */
/*case LFT_REPLY_SIZE_HEADERS: */
/*case LFT_REPLY_SIZE_BODY: */
/*case LFT_REPLY_SIZE_BODY_NO_TE: */

case LFT_IO_SIZE_TOTAL:
outint = al->cache.size + al->cache.rq_size;
doint = 1;
break;

case LFT_EXT_LOG:
if (al->request)
out = strBuf(al->request->extacl_log);

quote = 1;
break;

case LFT_PERCENT:
out = "%";
break;
}

if (doint) {
snprintf(tmp, sizeof(tmp), "%0*ld", fmt->zero ? (int) fmt->width : 0, outint);
out = tmp;
}
if (out && *out) {
if (quote || fmt->quote != LOG_QUOTE_NONE) {
char *newout = NULL;
int newfree = 0;
switch (fmt->quote) {
case LOG_QUOTE_NONE:
newout = rfc1738_escape_unescaped(out);
break;
case LOG_QUOTE_QUOTES:
newout = log_quoted_string(out);
newfree = 1;
break;
case LOG_QUOTE_BRAKETS:
newout = log_quote(out);
newfree = 1;
break;
case LOG_QUOTE_URL:
newout = rfc1738_escape(out);
break;
case LOG_QUOTE_RAW:
break;
}
if (newout) {
if (dofree)
safe_free(out);
out = newout;
dofree = newfree;
}
}
if (fmt->width) {
if (fmt->left)
memBufPrintf(&mb, "%-*s", (int) fmt->width, out);
else
memBufPrintf(&mb, "%*s", (int) fmt->width, out);
} else
memBufAppend(&mb, out, strlen(out));
} else {
memBufAppend(&mb, "-", 1);
}
if (fmt->space)
memBufAppend(&mb, " ", 1);
stringClean(&sb);
if (dofree)
safe_free(out);
}
logfilePrintf(logfile, "%s\n", mb.buf);
}

/* parses a single token. Returns the token length in characters,
* and fills in the lt item with the token information.
* def is for sure null-terminated
*/
static int
accessLogGetNewLogFormatToken(logformat_token * lt, char *def, enum log_quote *quote)
{
char *cur = def;
struct logformat_token_table_entry *lte;
int l;

memset(lt, 0, sizeof(*lt));
l = strcspn(cur, "%");
if (l > 0) {
char *cp;
/* it's a string for sure, until {COMENTARIO} or the next % */
cp = xmalloc(l + 1);
xstrncpy(cp, cur, l + 1);
lt->type = LFT_STRING;
lt->data.string = cp;
while (l > 0) {
switch (*cur) {
case '"':
if (*quote == LOG_QUOTE_NONE)
*quote = LOG_QUOTE_QUOTES;
else if (*quote == LOG_QUOTE_QUOTES)
*quote = LOG_QUOTE_NONE;
break;
case '[':
if (*quote == LOG_QUOTE_NONE)
*quote = LOG_QUOTE_BRAKETS;
break;
case ']':
if (*quote == LOG_QUOTE_BRAKETS)
*quote = LOG_QUOTE_NONE;
break;
}
cur++;
l--;
}
goto done;
}
if (!*cur)
goto done;
cur++;
switch (*cur) {
case '"':
lt->quote = LOG_QUOTE_QUOTES;
cur++;
break;
case '\'':
lt->quote = LOG_QUOTE_RAW;
cur++;
break;
case '[':
lt->quote = LOG_QUOTE_BRAKETS;
cur++;
break;
case '#':
lt->quote = LOG_QUOTE_URL;
cur++;
break;
default:
lt->quote = *quote;
break;
}
if (*cur == '-') {
lt->left = 1;
cur++;
}
if (*cur == '0') {
lt->zero = 1;
cur++;
}
if (xisdigit(*cur))
lt->width = strtol(cur, &cur, 10);
if (*cur == '.')
lt->precision = strtol(cur + 1, &cur, 10);
if (*cur == '{') {
char *cp;
cur++;
l = strcspn(cur, "}");
cp = xmalloc(l + 1);
xstrncpy(cp, cur, l + 1);
lt->data.string = cp;
cur += l;
if (*cur == '}')
cur++;
}
lt->type = LFT_NONE;
for (lte = logformat_token_table; lte->config != NULL; lte++) {
if (strncmp(lte->config, cur, strlen(lte->config)) == 0) {
lt->type = lte->token_type;
cur += strlen(lte->config);
break;
}
}
if (lt->type == LFT_NONE) {
fatalf("Can't parse configuration token: '%s'\n",
def);
}
if (*cur == ' ') {
lt->space = 1;
cur++;
}
done:
switch (lt->type) {
case LFT_REQUEST_HEADER:
case LFT_REPLY_HEADER:
if (lt->data.string) {
char *header = lt->data.string;
char *cp = strchr(header, ':');
if (cp) {
*cp++ = '{COMENTARIO}';
if (*cp == ',' || *cp == ';' || *cp == ':')
lt->data.header.separator = *cp++;
else
lt->data.header.separator = ',';
lt->data.header.element = cp;
lt->type = (lt->type == LFT_REQUEST_HEADER) ?
LFT_REQUEST_HEADER_ELEM :
LFT_REPLY_HEADER_ELEM;
}
lt->data.header.header = header;
} else {
lt->type = (lt->type == LFT_REQUEST_HEADER) ?
LFT_REQUEST_ALL_HEADERS :
LFT_REPLY_ALL_HEADERS;
Config.onoff.log_mime_hdrs = 1;
}
break;
case LFT_CLIENT_FQDN:
Config.onoff.log_fqdn = 1;
break;
case LFT_TIME_SUBSECOND:
lt->divisor = 1000;
if (lt->precision) {
int i;
lt->divisor = 1000000;
for (i = lt->precision; i > 1; i--)
lt->divisor /= 10;
if (!lt->divisor)
lt->divisor = 0;
}
break;
default:
break;
}
return (cur - def);
}

int
accessLogParseLogFormat(logformat_token ** fmt, char *def)
{
char *cur, *eos;
logformat_token *new_lt, *last_lt;
enum log_quote quote = LOG_QUOTE_NONE;

debug(46, 1) ("accessLogParseLogFormat: got definition '%s'\n", def);

/* very inefficent parser, but who cares, this needs to be simple */
/* First off, let's tokenize, we'll optimize in a second pass.
* A token can either be a %-prefixed sequence (usually a dynamic
* token but it can be an escaped sequence), or a string. */
cur = def;
eos = def + strlen(def);
*fmt = new_lt = last_lt = xmalloc(sizeof(logformat_token));
cur += accessLogGetNewLogFormatToken(new_lt, cur, "e);
while (cur < eos) {
new_lt = xmalloc(sizeof(logformat_token));
last_lt->next = new_lt;
last_lt = new_lt;
cur += accessLogGetNewLogFormatToken(new_lt, cur, "e);
}
return 1;
}

void
accessLogDumpLogFormat(StoreEntry * entry, const char *name, logformat * definitions)
{
logformat_token *t;
logformat *format;
struct logformat_token_table_entry *te;
debug(46, 4) ("accessLogDumpLogFormat called\n");

for (format = definitions; format; format = format->next) {
debug(46, 4) ("Dumping logformat definition for %s\n", format->name);
storeAppendPrintf(entry, "logformat %s ", format->name);
for (t = format->format; t; t = t->next) {
if (t->type == LFT_STRING)
storeAppendPrintf(entry, "%s", t->data.string);
else {
char argbuf[256];
char *arg = NULL;
logformat_bcode_t type = t->type;

switch (type) {
/* special cases */
case LFT_STRING:
break;
case LFT_REQUEST_HEADER_ELEM:
case LFT_REPLY_HEADER_ELEM:
if (t->data.header.separator != ',')
snprintf(argbuf, sizeof(argbuf), "%s:%c%s", t->data.header.header, t->data.header.separator, t->data.header.element);
else
snprintf(argbuf, sizeof(argbuf), "%s:%s", t->data.header.header, t->data.header.element);

arg = argbuf;
type = (type == LFT_REQUEST_HEADER_ELEM) ?
LFT_REQUEST_HEADER :
LFT_REPLY_HEADER;
break;

case LFT_REQUEST_ALL_HEADERS:
case LFT_REPLY_ALL_HEADERS:
type = (type == LFT_REQUEST_ALL_HEADERS) ?
LFT_REQUEST_HEADER :
LFT_REPLY_HEADER;
break;

default:
if (t->data.string)
arg = t->data.string;
break;
}
storeAppend(entry, "%", 1);
switch (t->quote) {
case LOG_QUOTE_QUOTES:
storeAppend(entry, "\"", 1);
break;
case LOG_QUOTE_BRAKETS:
storeAppend(entry, "[", 1);
break;
case LOG_QUOTE_URL:
storeAppend(entry, "#", 1);
break;
case LOG_QUOTE_RAW:
storeAppend(entry, "'", 1);
break;
case LOG_QUOTE_NONE:
break;
}
if (t->left)
storeAppend(entry, "-", 1);
if (t->zero)
storeAppend(entry, "0", 1);
if (t->width)
storeAppendPrintf(entry, "%d", (int) t->width);
if (t->precision)
storeAppendPrintf(entry, ".%d", (int) t->precision);
if (arg)
storeAppendPrintf(entry, "{%s}", arg);
for (te = logformat_token_table; te->config != NULL; te++) {
if (te->token_type == t->type) {
storeAppendPrintf(entry, "%s", te->config);
break;
}
}
if (t->space)
storeAppend(entry, " ", 1);
assert(te->config != NULL);
}
}
storeAppend(entry, "\n", 1);
}
}

void
accessLogFreeLogFormat(logformat_token ** tokens)
{
while (*tokens) {
logformat_token *token = *tokens;
*tokens = token->next;
safe_free(token->data.string);
xfree(token);
}
}

static void
accessLogSquid(AccessLogEntry * al, Logfile * logfile)
{
const char *client = NULL;
const char *user = NULL;
if (Config.onoff.log_fqdn)
client = fqdncache_gethostbyaddr(al->cache.caddr, FQDN_LOOKUP_IF_MISS);
if (client == NULL)
client = inet_ntoa(al->cache.caddr);
user = accessLogFormatName(al->cache.authuser);
if (!user)
user = accessLogFormatName(al->cache.rfc931);
#if USE_SSL
if (!user)
user = accessLogFormatName(al->cache.ssluser);
#endif
if (user && !*user)
safe_free(user);
if (!Config.onoff.log_mime_hdrs) {
logfilePrintf(logfile, "%9ld.%03d %6d %s %s/%03d %" PRINTF_OFF_T " %s %s %s %s%s/%s %s\n",
(long int) current_time.tv_sec,
(int) current_time.tv_usec / 1000,
al->cache.msec,
client,
log_tags[al->cache.code],
al->http.code,
al->cache.size,
al->private.method_str,
al->url,
user ? user : dash_str,
al->hier.ping.timedout ? "TIMEOUT_" : "",
hier_strings[al->hier.code],
al->hier.host,
al->http.content_type);

strcpy(insertSQL,"INSERT INTO logSquid( date, clientIP, tags_HIT_MISS, http_code, cache_size, private_method_str, url, user) values ( now(),'");
strcat(insertSQL,client);
strcat(insertSQL,"','");
strcat(insertSQL,log_tags[al->cache.code]);
strcat(insertSQL,"','");


snprintf(intconvstr,3,"%d",al->http.code);
strcat(insertSQL,intconvstr); // Sprintf(Stringdestino,tipodeconverção"%d INTEIRO",valorinteiro)

strcat(insertSQL,"','");
snprintf(intconvstr,11,"%d",al->cache.size);

strcat(insertSQL,intconvstr);
strcat(insertSQL,"','");
strcat(insertSQL,al->private.method_str);
strcat(insertSQL,"','");
strcat(insertSQL,al->url);
strcat(insertSQL,"','");
strcat(insertSQL,user ? user : dash_str);
strcat(insertSQL,"');");

mysql_init(&conexao);
if ( mysql_real_connect(&conexao, "localhost", "Usuario", "Senha", "SeuBANCO", 0, NULL, 0) )
{
res = mysql_query(&conexao,insertSQL);
if (!res) logfilePrintf(logfile,"Registros inseridos %d\n", mysql_affected_rows(&conexao));
else logfilePrintf(logfile,"Erro na inserção %d : %s\n", mysql_errno(&conexao), mysql_error(&conexao));
mysql_close(&conexao);

}
else
{
logfilePrintf(logfile,"Falha de conexao\n");
logfilePrintf(logfile,"Erro %d : %s\n", mysql_errno(&conexao), mysql_error(&conexao));
}
} else {
char *ereq = log_quote(al->headers.request);
char *erep = log_quote(al->headers.reply);
logfilePrintf(logfile, "%9ld.%03d %6d %s %s/%03d %" PRINTF_OFF_T " %s %s %s %s%s/%s %s [%s] [%s]\n",
(long int) current_time.tv_sec,
(int) current_time.tv_usec / 1000,
al->cache.msec,
client,
log_tags[al->cache.code],
al->http.code,
al->cache.size,
al->private.method_str,
al->url,
user ? user : dash_str,
al->hier.ping.timedout ? "TIMEOUT_" : "",
hier_strings[al->hier.code],
al->hier.host,
al->http.content_type,
ereq,
erep);
safe_free(ereq);
safe_free(erep);
}
safe_free(user);
}

static void
accessLogCommon(AccessLogEntry * al, Logfile * logfile)
{
const char *client = NULL;
char *user1 = NULL, *user2 = NULL;
if (Config.onoff.log_fqdn)
client = fqdncache_gethostbyaddr(al->cache.caddr, 0);
if (client == NULL)
client = inet_ntoa(al->cache.caddr);
user1 = accessLogFormatName(al->cache.authuser);
user2 = accessLogFormatName(al->cache.rfc931);
logfilePrintf(logfile, "%s %s %s [%s] \"%s %s HTTP/%d.%d\" %d %" PRINTF_OFF_T " %s:%s",
client,
user2 ? user2 : dash_str,
user1 ? user1 : dash_str,
mkhttpdlogtime(&squid_curtime),
al->private.method_str,
al->url,
al->http.version.major, al->http.version.minor,
al->http.code,
al->cache.size,
log_tags[al->cache.code],
hier_strings[al->hier.code]);
safe_free(user1);
safe_free(user2);
if (Config.onoff.log_mime_hdrs) {
char *ereq = log_quote(al->headers.request);
char *erep = log_quote(al->headers.reply);
logfilePrintf(logfile, " [%s] [%s]\n", ereq, erep);
safe_free(ereq);
safe_free(erep);
} else {
logfilePrintf(logfile, "\n");
}
}

void
accessLogLog(AccessLogEntry * al, aclCheck_t * checklist)
{
customlog *log;
if (LogfileStatus != LOG_ENABLE)
return;
if (al->url == NULL)
al->url = dash_str;
if (!al->http.content_type || *al->http.content_type == '{COMENTARIO}')
al->http.content_type = dash_str;
if (al->icp.opcode)
al->private.method_str = icp_opcode_str[al->icp.opcode];
else
al->private.method_str = RequestMethodStr[al->http.method];
if (al->hier.host[0] == '{COMENTARIO}')
xstrncpy(al->hier.host, dash_str, SQUIDHOSTNAMELEN);

for (log = Config.Log.accesslogs; log; log = log->next) {
if (checklist && log->aclList && aclMatchAclList(log->aclList, checklist) != 1)
continue;
switch (log->type) {
case CLF_AUTO:
if (Config.onoff.common_log)
accessLogCommon(al, log->logfile);
else
accessLogSquid(al, log->logfile);
break;
case CLF_SQUID:
accessLogSquid(al, log->logfile);
break;
case CLF_COMMON:
accessLogCommon(al, log->logfile);
break;
case CLF_CUSTOM:
accessLogCustom(al, log);
break;
case CLF_NONE:
goto last;
default:
fatalf("Unknown log format %d\n", log->type);
break;
}
logfileFlush(log->logfile);
if (!checklist)
break;
}
last:
(void) 0; /* NULL statement for label */

#if MULTICAST_MISS_STREAM
if (al->cache.code != LOG_TCP_MISS)
(void) 0;
else if (al->http.method != METHOD_GET)
(void) 0;
else if (mcast_miss_fd < 0)
(void) 0;
else {
unsigned int ibuf[365];
size_t isize;
xstrncpy((char *) ibuf, al->url, 364 * sizeof(int));
isize = ((strlen(al->url) + 8) / 8) * 2;
if (isize > 364)
isize = 364;
mcast_encode((unsigned int *) ibuf, isize,
(const unsigned int *) Config.mcast_miss.encode_key);
comm_udp_sendto(mcast_miss_fd,
&mcast_miss_to, sizeof(mcast_miss_to),
ibuf, isize * sizeof(int));
}
#endif
}

void
accessLogRotate(void)
{
customlog *log;
#if FORW_VIA_DB
fvdbClear();
#endif
for (log = Config.Log.accesslogs; log; log = log->next) {
if (log->logfile) {
logfileRotate(log->logfile);
}
}
#if HEADERS_LOG
logfileRotate(headerslog);
#endif
}

void
accessLogClose(void)
{
customlog *log;
for (log = Config.Log.accesslogs; log; log = log->next) {
if (log->logfile) {
logfileClose(log->logfile);
log->logfile = NULL;
}
}
#if HEADERS_LOG
logfileClose(headerslog);
headerslog = NULL;
#endif
}

void
hierarchyNote(HierarchyLogEntry * hl,
hier_code code,
const char *cache_peer)
{
assert(hl != NULL);
hl->code = code;
xstrncpy(hl->host, cache_peer, SQUIDHOSTNAMELEN);
}

void
accessLogInit(void)
{
customlog *log;
for (log = Config.Log.accesslogs; log; log = log->next) {
if (log->type == CLF_NONE)
continue;
log->logfile = logfileOpen(log->filename, MAX_URL << 1, 1);
LogfileStatus = LOG_ENABLE;
}
#if HEADERS_LOG
headerslog = logfileOpen("/usr/local/squid/logs/headers.log", MAX_URL << 1, 0);
assert(NULL != headerslog);
#endif
#if FORW_VIA_DB
fvdbInit();
#endif
#if MULTICAST_MISS_STREAM
if (Config.mcast_miss.addr.s_addr != no_addr.s_addr) {
memset(&mcast_miss_to, '{COMENTARIO}', sizeof(mcast_miss_to));
mcast_miss_to.sin_family = AF_INET;
mcast_miss_to.sin_port = htons(Config.mcast_miss.port);
mcast_miss_to.sin_addr.s_addr = Config.mcast_miss.addr.s_addr;
mcast_miss_fd = comm_open(SOCK_DGRAM,
IPPROTO_UDP,
Config.Addrs.udp_incoming,
Config.mcast_miss.port,
COMM_NONBLOCKING,
"Multicast Miss Stream");
if (mcast_miss_fd < 0)
fatal("Cannot open Multicast Miss Stream Socket");
debug(46, 1) ("Multicast Miss Stream Socket opened on FD %d\n",
mcast_miss_fd);
mcastSetTtl(mcast_miss_fd, Config.mcast_miss.ttl);
if (strlen(Config.mcast_miss.encode_key) < 16)
fatal("mcast_encode_key is too short, must be 16 characters");
}
#endif
}

const char *
accessLogTime(time_t t)
{
struct tm *tm;
static char buf[128];
static time_t last_t = 0;
if (t != last_t) {
tm = localtime(&t);
strftime(buf, 127, "%Y/%m/%d %H:%M:%S", tm);
last_t = t;
}
return buf;
}


#if FORW_VIA_DB

static void
fvdbInit(void)
{
via_table = hash_create((HASHCMP *) strcmp, 977, hash4);
forw_table = hash_create((HASHCMP *) strcmp, 977, hash4);
cachemgrRegister("via_headers", "Via Request Headers", fvdbDumpVia, 0, 1);
cachemgrRegister("forw_headers", "X-Forwarded-For Request Headers",
fvdbDumpForw, 0, 1);
}

static void
fvdbCount(hash_table * hash, const char *key)
{
fvdb_entry *fv;
if (NULL == hash)
return;
fv = hash_lookup(hash, key);
if (NULL == fv) {
fv = xcalloc(1, sizeof(fvdb_entry));
fv->hash.key = xstrdup(key);
hash_join(hash, &fv->hash);
}
fv->n++;
}

void
fvdbCountVia(const char *key)
{
fvdbCount(via_table, key);
}

void
fvdbCountForw(const char *key)
{
fvdbCount(forw_table, key);
}

static void
fvdbDumpTable(StoreEntry * e, hash_table * hash)
{
hash_link *h;
fvdb_entry *fv;
if (hash == NULL)
return;
hash_first(hash);
while ((h = hash_next(hash))) {
fv = (fvdb_entry *) h;
storeAppendPrintf(e, "%9d %s\n", fv->n, hashKeyStr(&fv->hash));
}
}

static void
fvdbDumpVia(StoreEntry * e)
{
fvdbDumpTable(e, via_table);
}

static void
fvdbDumpForw(StoreEntry * e)
{
fvdbDumpTable(e, forw_table);
}

static
void
fvdbFreeEntry(void *data)
{
fvdb_entry *fv = data;
xfree(fv->hash.key);
xfree(fv);
}

static void
fvdbClear(void)
{
hashFreeItems(via_table, fvdbFreeEntry);
hashFreeMemory(via_table);
via_table = hash_create((HASHCMP *) strcmp, 977, hash4);
hashFreeItems(forw_table, fvdbFreeEntry);
hashFreeMemory(forw_table);
forw_table = hash_create((HASHCMP *) strcmp, 977, hash4);
}

#endif

#if MULTICAST_MISS_STREAM
/*
* From http://www.io.com/~paulhart/game/algorithms/tea.html
*
* size of 'ibuf' must be a multiple of 2.
* size of 'key' must be 4.
* 'ibuf' is modified in place, encrypted data is written in
* network byte order.
*/
static void
mcast_encode(unsigned int *ibuf, size_t isize, const unsigned int *key)
{
unsigned int y;
unsigned int z;
unsigned int sum;
const unsigned int delta = 0x9e3779b9;
unsigned int n = 32;
const unsigned int k0 = htonl(key[0]);
const unsigned int k1 = htonl(key[1]);
const unsigned int k2 = htonl(key[2]);
const unsigned int k3 = htonl(key[3]);
int i;
for (i = 0; i < isize; i += 2) {
y = htonl(ibuf[i]);
z = htonl(ibuf[i + 1]);
sum = 0;
for (n = 32; n; n--) {
sum += delta;
y += (z << 4) + (k0 ^ z) + (sum ^ (z >> 5)) + k1;
z += (y << 4) + (k2 ^ y) + (sum ^ (y >> 5)) + k3;
}
ibuf[i] = htonl(y);
ibuf[i + 1] = htonl(z);
}
}

#endif

#if HEADERS_LOG
void
headersLog(int cs, int pq, method_t m, void *data)
{
HttpReply *rep;
request_t *req;
unsigned short magic = 0;
unsigned char M = (unsigned char) m;
unsigned short S;
char *hmask;
int ccmask = 0;
if (0 == pq) {
/* reply */
rep = data;
req = NULL;
magic = 0x0050;
hmask = rep->header.mask;
if (rep->cache_control)
ccmask = rep->cache_control->mask;
} else {
/* request */
req = data;
rep = NULL;
magic = 0x0051;
hmask = req->header.mask;
if (req->cache_control)
ccmask = req->cache_control->mask;
}
if (0 == cs) {
/* client */
magic |= 0x4300;
} else {
/* server */
magic |= 0x5300;
}
magic = htons(magic);
ccmask = htonl(ccmask);
if (0 == pq)
S = (unsigned short) rep->sline.status;
else
S = (unsigned short) HTTP_STATUS_NONE;
logfileWrite(headerslog, &magic, sizeof(magic));
logfileWrite(headerslog, &M, sizeof(M));
logfileWrite(headerslog, &S, sizeof(S));
logfileWrite(headerslog, hmask, sizeof(HttpHeaderMask));
logfileWrite(headerslog, &ccmask, sizeof(int));
logfileFlush(headerslog);
}

#endif

[11] Comentário enviado por balani em 09/01/2008 - 19:54h

Valeu Amigo, vou testar

[12] Comentário enviado por balani em 10/01/2008 - 09:56h

Agora deu certo, muito obrigado pela atenção.

[13] Comentário enviado por rosemberg em 02/09/2008 - 23:09h

Filipe Meus parabens adorei o artigo como sou novato em linux, surgiu uma duvida, no meu caso o mysql encontra-se em outro servidor, seria possivel o redirecionamento ?

[14] Comentário enviado por m@verick em 03/09/2008 - 10:10h

Acredito que sim rosemberg, apesar de pessoalmente eu não ter testado, bastaria alterar esta parte do código

if ( mysql_real_connect(&conexao, "localhost", "Usuario", "Senha", "SeuBANCO", 0, NULL, 0) )
{

que está definindo o servidor como "localhost" para o "IP DE SEU SERVIDOR" , mas vale lembrar que isto geraria muito tráfego em sua rede por isso seria interessante ter um switch ou mesmo optar por manter o banco local mesmo.
Espero ter ajudado, T+

[15] Comentário enviado por viniciuspedra em 23/04/2009 - 17:46h

duvida...
para fazer esta inserção no mysql eu posso usar o squid q já eh instalado no debian ou terei que baixar a versão indicada no script?

[16] Comentário enviado por m@verick em 24/04/2009 - 00:30h

Olá Vinícius, na verdade o squid quando instalado pelo apt já foi compilado de modo que não é possível realizar as alterações necessárias, assim é preciso seguir o script baixando o source, realizando as alterações e posteriormente gerando uma nova compilação.
Espero ter ajudado, até mais.

[17] Comentário enviado por robsonsbrasil em 18/08/2009 - 08:32h

Bom dia amigos,

Estou seguindo esse tutorial a risca mas estou com o seguinte problema.

=== Depois de fazer toda conf no access_log.c e executo:

./configure CFLAGS=-lmysqlclient --enable-storeio=diskd,ufs

=== Ele mostra o seguinte:

checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for gawk... no
checking for mawk... mawk
checking whether make sets $(MAKE)... yes
checking whether to enable maintainer-specific portions of Makefiles... no
checking for gcc... gcc
checking for C compiler default output file name...
configure: error: C compiler cannot create executables
See `config.log' for more details.


==== Veja um trecho meu config.log o qual ele meciona

$ ./configure CFLAGS=-lmysqlclient --enable-storeio=diskd,ufs

## --------- ##
## Platform. ##
## --------- ##

hostname = burucutu
uname -m = i686
uname -r = 2.6.26-2-686
uname -s = Linux
uname -v = #1 SMP Sun Jun 21 04:57:38 UTC 2009

/usr/bin/uname -p = unknown
/bin/uname -X = unknown

/bin/arch = unknown
/usr/bin/arch -k = unknown
/usr/convex/getsysinfo = unknown
/usr/bin/hostinfo = unknown
/bin/machine = unknown
/usr/bin/oslevel = unknown
/bin/universe = unknown

PATH: /usr/local/sbin
PATH: /usr/local/bin
PATH: /usr/sbin
PATH: /usr/bin
PATH: /sbin
PATH: /bin

## ----------- ##
## Core tests. ##
## ----------- ##

configure:2080: checking for a BSD-compatible install
configure:2136: result: /usr/bin/install -c
configure:2147: checking whether build environment is sane
configure:2190: result: yes
configure:2255: checking for gawk
configure:2285: result: no
configure:2255: checking for mawk
configure:2271: found /usr/bin/mawk
configure:2282: result: mawk
configure:2293: checking whether make sets $(MAKE)
configure:2314: result: yes
configure:2499: checking whether to enable maintainer-specific portions of Makefiles
configure:2508: result: no
configure:2579: checking for gcc
configure:2595: found /usr/bin/gcc
configure:2606: result: gcc
configure:2844: checking for C compiler version
configure:2851: gcc --version >&5
gcc (Debian 4.3.2-1.1) 4.3.2
Copyright (C) 2008 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

=== VEJA O /usr/bin/

g++ gcov getconf gettext gpg gpg-zip grog gtbl
g++-4.3 gcov-4.3 getent gettext.sh gpg-convert-from-106 gpic grops
gcc gencat getkeycodes ginstall-info gpgsplit gprof grotty
gcc-4.3 geqn getopt gpasswd gpgv groff groups

c++ c99-gcc catman chattr chsh cmp column consolechars cpanp-run-perl ctstat
c2ph cal cc chcon chvt codepage comm corelist cpp cut
c89 calendar c++filt chfn cksum col comp_err cpan cpp-4.3
c89-gcc captoinfo chage chkdupexe clear colcrt compose cpan2dist crontab
c99 catchsegv charset chrt clear_console colrm config_data cpanp csplit

=== Minha dist Debian 5 (lenny) - squid-2.6.STABLE16

Já coloquei o squid 3 e deu a mesma coisa

Gostaria da colaboração de vocês agradeço desde já
Abracos

PS: m@verick mandei uma mensagem e você não respondeu se possível responda.

[18] Comentário enviado por m0r473n53 em 05/09/2009 - 00:37h

Ola Robson.
tente instalar o pacote libmysqlclient15-dev e tente novamente.

abraço t+

[19] Comentário enviado por m@verick em 05/09/2009 - 13:15h

Me desculpe Robson, estava meio sem tempo para responder, fui postergando e acabei me esquecendo como m0r473n53 disse tente instalar a lib libmysqlclient15-dev

apt-get install libmysqlclient15-dev

Caso não de certo aguardo contato, T+.

[20] Comentário enviado por junior em 11/09/2009 - 19:47h

E aí irmão, certinho?
Eu copiei todo o access_log do seu comentário, o que você disse que funcionou e no final do make && make install, dá os seguintes erros:
access_log.cc:105:8: error: character constant too long for its type
access_log.cc:116:51: error: character constant too long for its type
access_log.cc:159:15: error: character constant too long for its type
access_log.cc:173:8: error: character constant too long for its type
access_log.cc:182:51: error: character constant too long for its type
access_log.cc:201:15: error: character constant too long for its type
access_log.cc:210:16: error: character constant too long for its type
access_log.cc:226:6: error: character constant too long for its type
access_log.cc:250:8: error: character constant too long for its type
access_log.cc:849:9: error: character constant too long for its type
access_log.cc:1155:57: error: character constant too long for its type
access_log.cc:1161:25: error: character constant too long for its type
access_log.cc: In function âchar* log_quote(const char*)â:
access_log.cc:104: error: invalid conversion from âvoid*â to âchar*â
cc1plus: warnings being treated as errors
access_log.cc:105: error: overflow in implicit constant conversion
access_log.cc:108: error: invalid conversion from âvoid*â to âchar*â
access_log.cc:159: error: overflow in implicit constant conversion
access_log.cc: In function âchar* username_quote(const char*)â:
access_log.cc:172: error: invalid conversion from âvoid*â to âchar*â
access_log.cc:173: error: overflow in implicit constant conversion
access_log.cc:176: error: invalid conversion from âvoid*â to âchar*â
access_log.cc:201: error: overflow in implicit constant conversion
access_log.cc: In function âchar* log_quoted_string(const char*)â:
access_log.cc:218: error: invalid conversion from âvoid*â to âchar*â
access_log.cc:226: error: overflow in implicit constant conversion
access_log.cc:250: error: overflow in implicit constant conversion
access_log.cc: At global scope:
access_log.cc:437: error: variable or field âaccessLogCustomâ declared void
access_log.cc:437: error: âAccessLogEntryâ was not declared in this scope
access_log.cc:437: error: âalâ was not declared in this scope
access_log.cc:437: error: expected primary-expression before â*â token
access_log.cc:72: error: âLogfileStatusâ defined but not used
access_log.cc:206: error: âchar* accessLogFormatName(const char*)â defined but not used
access_log.cc:216: error: âchar* log_quoted_string(const char*)â defined but not used
make[3]: ** [access_log.o] Erro 1
make[3]: Saindo do diretório `/root/Arquivos/squid-3.0.STABLE19/src'
make[2]: ** [all-recursive] Erro 1
make[2]: Saindo do diretório `/root/Arquivos/squid-3.0.STABLE19/src'
make[1]: ** [all] Erro 2
make[1]: Saindo do diretório `/root/Arquivos/squid-3.0.STABLE19/src'
make: ** [all-recursive] Erro 1

[21] Comentário enviado por SheylaCristina em 10/04/2010 - 14:51h

gostaria de uma solução de como gravas os logs de acesso do squid no mysql, testei esse tutorial mas nao obtive resultado. O log do squid deve ser gravado no mysql sem auxilio de mysar.

[22] Comentário enviado por m@verick em 10/04/2010 - 16:50h

Olá Sheyla, vc poderia me informar onde esta ocorrendo o problema para que eu possa tentar ajudar, pois esta não é lá das melhores soluções mas funciona desde que esteja atenta as alterações que são necessarias fazer no fonte e todos os passos configuração como o banco de dados, ja faz algum tempo que aplico esta solução, preciso me atualizar com as novas versões do squid.

[23] Comentário enviado por sheylacristina em 15/04/2010 - 10:18h

intao e que preciso saber como eu gravo todos os meus logs do squid no mysql preciso que os logs sejam gravados de forma automatica e a leitura possa ser feita atraves do php como no apache sabe, qndo nos gravamos os logs do apache no mysql e utilizamos o phpmyadmim para visualizar ?! Poise preciso da msma coisa so que neste caso com o SQUID.

[24] Comentário enviado por viniciuspedra em 05/07/2010 - 17:00h

olá! é necessário compilar este squid? Não pode ser utilizado o nativo do linux?

[25] Comentário enviado por keuzar em 10/11/2010 - 09:24h

M@averick, compilei o source normalmente, instalei, mas quanto tento subir o squid ele retorna um erro -- FATAL: cache_dir /usr/local/squid/var/cache: (2) No such file or directory

criei o diretorio cache, e novamente quando tento subir retorna outro erro -- FATAL: Could not determine fully qualified hostname. Please set 'visible_hostname'

pode me ajudar?

[26] Comentário enviado por m@verick em 10/11/2010 - 10:02h

vc executou o squid -z para criar os diretorios de cache, depois confira se os diretorios realmente estao lá, t+

[27] Comentário enviado por keuzar em 11/11/2010 - 08:24h

quando eu executo squid -z diz q o programa nao esta instalado, mas eu executei o make, make install e ate onde vi nao deu erro... que coisa em!!!
q ki eu faco?

to dependendo disso pra faze um trabalho da facul, da um help ai..vlw

[28] Comentário enviado por m@verick em 11/11/2010 - 11:18h

Seguinte procure na pasta onde vc realizou a compilação pelo arquivos binarios, deve haver a pasta bin e lá deve estar o executavel, por ex. vc compilou na pasta /dados ae vc executará o squid da /dados/bin/squid se nao me engano to tentanto lembrar de kbça... de uma procurada OK, espero ajudar t+.

[29] Comentário enviado por keuzar em 11/11/2010 - 19:35h

cara..desculpa a ignorancia, mas to bastante confuso.. a pasta bin esta no diretorio /usr/local/squid
nele contem os executaveis RunCache e SquidClient.., tento executa o SquidCliente ele retorna mensagem de conexao recusada no localhost porta 3128..
na pasta sbin existe o executavel squid, ele sim retorna os erros que te falei no meu primeiro comentario.

sinceramente nao sei oq fazer ..

[30] Comentário enviado por glaucoperucchi em 14/03/2011 - 23:46h

Boa noite amigo,

Estou com seguinte problema, copiei teu fonte dos comentarios cujo o balani disse que funcionou. Mas no meu esta acontecendo o do mesmo erro do junior.rocha.

access_log.c:105:8: warning: character constant too long for its type
access_log.c: In function ‘log_quote’:
access_log.c:105: warning: overflow in implicit constant conversion
access_log.c:116:51: warning: character constant too long for its type
access_log.c:159:15: warning: character constant too long for its type
access_log.c:159: warning: overflow in implicit constant conversion
access_log.c:173:8: warning: character constant too long for its type
access_log.c: In function ‘username_quote’:
access_log.c:173: warning: overflow in implicit constant conversion
access_log.c:182:51: warning: character constant too long for its type
access_log.c:201:15: warning: character constant too long for its type
access_log.c:201: warning: overflow in implicit constant conversion
access_log.c:210:16: warning: character constant too long for its type
access_log.c:226:6: warning: character constant too long for its type
access_log.c: In function ‘log_quoted_string’:
access_log.c:226: warning: case label value exceeds maximum value for type
access_log.c:250:8: warning: character constant too long for its type
access_log.c:250: warning: overflow in implicit constant conversion
access_log.c:849:9: warning: character constant too long for its type
access_log.c: In function ‘accessLogGetNewLogFormatToken’:
access_log.c:849: warning: overflow in implicit constant conversion
access_log.c:1155:57: warning: character constant too long for its type
access_log.c:1161:25: warning: character constant too long for its type
make[3]: ** [access_log.o] Erro 1
make[3]: Saindo do diretório `/usr/local/etc/squid-2.6.STABLE16/src'
make[2]: ** [all-recursive] Erro 1
make[2]: Saindo do diretório `/usr/local/etc/squid-2.6.STABLE16/src'
make[1]: ** [all] Erro 2
make[1]: Saindo do diretório `/usr/local/etc/squid-2.6.STABLE16/src'
make: ** [all-recursive] Erro 1

Poderia me ajudar?
Obrigado pela atenção

[31] Comentário enviado por m@verick em 30/03/2011 - 08:50h

opa me desculpem pela demora,
Este erro glauco.skt se deve a alguma incompatilbilidade com o GCC, não me recordo a versao que usavao antes , ao inves de opiar o fonte tente alterar apenas a linhas indicadas no codigo fonte original.

[32] Comentário enviado por fabriciobslogan em 27/04/2011 - 16:34h

Puxa sou iniciante no squid e isso me ajudou bastante sempre tive interesse em saber o que significava cada item!!!
Muito Obrigado !!!
vlw.
Fica com Deus!!!

[33] Comentário enviado por ewerton.silveira em 16/11/2011 - 23:08h

Cara adorei seu tópico sobre o log do squid fiz aqui e funciono só gostaria de saber como ficaria o codigo para que todas as informaçoes do log ficasse armazenadas no bd?

OBS: Mandei a dúvida por email mais acredito que possa ser util para outros por isso postei aqui também!!

Att,

Ewerton Silveira

[34] Comentário enviado por m@verick em 25/11/2011 - 10:14h

Ewerton,
desculpa a demora em respoder cara, seguinte para armazenar todos os dados no db basta
incluir os campos que vc deseja e da uma olhada nos atributos disponiveis no obj al->
p ex para pegar a url solicita usamos al->url e concatemos direto na string SQL pq ->url ja é string os demais itens basta verificar o tipo e fazer as conversões, todo o caso me posta os itens que vc ficou em duvida e deseja incluir, T+.

[35] Comentário enviado por vermei em 22/05/2012 - 11:56h

Olá segui todos os passos, mas quando executo o comando make da o seguite erro.


Making all in lib
make[1]: Entrando no diretório `/home/usuario/squid-2.7.STABLE9/lib'
make[1]: Nada a ser feito para `all'.
make[1]: Saindo do diretório `/home/usuario/squid-2.7.STABLE9/lib'
Making all in scripts
make[1]: Entrando no diretório `/home/usuario/squid-2.7.STABLE9/scripts'
make[1]: Nada a ser feito para `all'.
make[1]: Saindo do diretório `/home/usuario/squid-2.7.STABLE9/scripts'
Making all in src
make[1]: Entrando no diretório `/home/usuario/squid-2.7.STABLE9/src'
sed "\
s%@DEFAULT_HTTP_PORT@%3128%g;\
s%@DEFAULT_ICP_PORT@%3130%g;\
s%@DEFAULT_MIME_TABLE@%/usr/local/squid/etc/mime.conf%g;\
s%@DEFAULT_DNSSERVER@%/usr/local/squid/libexec/`echo dnsserver | sed 's,x,x,;s/$//'`%g;\
s%@DEFAULT_UNLINKD@%/usr/local/squid/libexec/`echo unlinkd | sed 's,x,x,;s/$//'`%g;\
s%@DEFAULT_PINGER@%/usr/local/squid/libexec/`echo pinger | sed 's,x,x,;s/$//'`%g;\
s%@DEFAULT_DISKD@%/usr/local/squid/libexec/`echo diskd-daemon | sed 's,x,x,;s/$//'`%g;\
s%@DEFAULT_LOGFILED@%/usr/local/squid/libexec/`echo logfile-daemon | sed 's,x,x,;s/$//'`%g;\
s%@DEFAULT_CACHE_LOG@%/usr/local/squid/var/logs/cache.log%g;\
s%@DEFAULT_ACCESS_LOG@%/usr/local/squid/var/logs/access.log%g;\
s%@DEFAULT_STORE_LOG@%/usr/local/squid/var/logs/store.log%g;\
s%@DEFAULT_PID_FILE@%/usr/local/squid/var/logs/squid.pid%g;\
s%@DEFAULT_NETDB_FILE@%/usr/local/squid/var/logs/netdb.state%g;\
s%@DEFAULT_SWAP_DIR@%/usr/local/squid/var/cache%g;\
s%@DEFAULT_ICON_DIR@%/usr/local/squid/share/icons%g;\
s%@DEFAULT_MIB_PATH@%/usr/local/squid/share/mib.txt%g;\
s%@DEFAULT_ERROR_DIR@%/usr/local/squid/share/errors/English%g;\
s%@DEFAULT_PREFIX@%/usr/local/squid%g;\
s%@DEFAULT_HOSTS@%/etc/hosts%g;\
s%@[V]ERSION@%2.7.STABLE9%g;"\
< ./cf.data.pre >cf.data
./cf_gen cf.data ./cf.data.depend
/bin/bash ./repl_modules.sh lru > repl_modules.c
/bin/bash ./store_modules.sh diskd ufs >store_modules.c
make all-recursive
make[2]: Entrando no diretório `/home/usuario/squid-2.7.STABLE9/src'
Making all in fs
make[3]: Entrando no diretório `/home/usuario/squid-2.7.STABLE9/src/fs'
make[3]: Nada a ser feito para `all'.
make[3]: Saindo do diretório `/home/usuario/squid-2.7.STABLE9/src/fs'
Making all in repl
make[3]: Entrando no diretório `/home/usuario/squid-2.7.STABLE9/src/repl'
make[3]: Nada a ser feito para `all'.
make[3]: Saindo do diretório `/home/usuario/squid-2.7.STABLE9/src/repl'
Making all in auth
make[3]: Entrando no diretório `/home/usuario/squid-2.7.STABLE9/src/auth'
make[3]: Nada a ser feito para `all'.
make[3]: Saindo do diretório `/home/usuario/squid-2.7.STABLE9/src/auth'
make[3]: Entrando no diretório `/home/usuario/squid-2.7.STABLE9/src'
gcc -DHAVE_CONFIG_H -DDEFAULT_CONFIG_FILE=\"/usr/local/squid/etc/squid.conf\" -I. -I../include -I. -I. -I../include -I../include -lmysqlclient -MT access_log.o -MD -MP -MF .deps/access_log.Tpo -c -o access_log.o access_log.c
access_log.c: Na função âlog_quoteâ:
access_log.c:106:8: aviso: constante de caracteres muito longa para seu tipo [habilitado por padrão]
access_log.c:106:1: aviso: overflow in implicit constant conversion [-Woverflow]
access_log.c:117:51: aviso: constante de caracteres muito longa para seu tipo [habilitado por padrão]
access_log.c:160:15: aviso: constante de caracteres muito longa para seu tipo [habilitado por padrão]
access_log.c:160:1: aviso: overflow in implicit constant conversion [-Woverflow]
access_log.c: Na função âusername_quoteâ:
access_log.c:174:8: aviso: constante de caracteres muito longa para seu tipo [habilitado por padrão]
access_log.c:174:1: aviso: overflow in implicit constant conversion [-Woverflow]
access_log.c:183:51: aviso: constante de caracteres muito longa para seu tipo [habilitado por padrão]
access_log.c:202:15: aviso: constante de caracteres muito longa para seu tipo [habilitado por padrão]
access_log.c:202:1: aviso: overflow in implicit constant conversion [-Woverflow]
access_log.c: Na função âaccessLogFormatNameâ:
access_log.c:211:16: aviso: constante de caracteres muito longa para seu tipo [habilitado por padrão]
access_log.c: Na função âlog_quoted_stringâ:
access_log.c:227:6: aviso: constante de caracteres muito longa para seu tipo [habilitado por padrão]
access_log.c:227:1: aviso: case label value exceeds maximum value for type [habilitado por padrão]
access_log.c:251:8: aviso: constante de caracteres muito longa para seu tipo [habilitado por padrão]
access_log.c:251:1: aviso: overflow in implicit constant conversion [-Woverflow]
access_log.c: Na função âaccessLogGetNewLogFormatTokenâ:
access_log.c:850:9: aviso: constante de caracteres muito longa para seu tipo [habilitado por padrão]
access_log.c:850:1: aviso: overflow in implicit constant conversion [-Woverflow]
access_log.c: Na função âaccessLogSquidâ:
access_log.c:1065:1: aviso: formato â%dâ expects argument of type âintâ, but argument 4 has type âsquid_off_tâ [-Wformat]
access_log.c:1065:1: aviso: formato â%dâ expects argument of type âintâ, but argument 4 has type âsquid_off_tâ [-Wformat]
access_log.c:1080:1: aviso: formato â%dâ expects argument of type âintâ, but argument 3 has type âmy_ulonglongâ [-Wformat]
access_log.c: Na função âaccessLogLogâ:
access_log.c:1168:57: aviso: constante de caracteres muito longa para seu tipo [habilitado por padrão]
access_log.c:1173:26: erro: âRequestMethodStrâ undeclared (first use in this function)
access_log.c:1173:26: nota: each undeclared identifier is reported only once for each function it appears in
access_log.c:1174:25: aviso: constante de caracteres muito longa para seu tipo [habilitado por padrão]
make[3]: ** [access_log.o] Erro 1
make[3]: Saindo do diretório `/home/usuario/squid-2.7.STABLE9/src'
make[2]: ** [all-recursive] Erro 1
make[2]: Saindo do diretório `/home/usuario/squid-2.7.STABLE9/src'
make[1]: ** [all] Erro 2
make[1]: Saindo do diretório `/home/usuario/squid-2.7.STABLE9/src'
make: ** [all-recursive] Erro 1

[36] Comentário enviado por marcos.ths em 27/03/2014 - 10:30h

Amigo, funciona com squid3 ?

Pois estou tentando aqui e esta dando erros na compilação.

[37] Comentário enviado por m@verick em 25/05/2020 - 20:47h


[36] Comentário enviado por marcos.ths em 27/03/2014 - 10:30h

Amigo, funciona com squid3 ?

Pois estou tentando aqui e esta dando erros na compilação.


Marcos as bibliotecas mudaram muito mas na versão 2
vai que é um fuke...


Contribuir com comentário




Patrocínio

Site hospedado pelo provedor RedeHost.
Linux banner

Destaques

Artigos

Dicas

Tópicos

Top 10 do mês

Scripts