Performance question for very large site Options

[GoleyC]

Scott,

That very good news. Looking forward to reviewing the script once it becomes more stable.

[Craig]

Hi all,

i´ve got a Problem with the delivery option "Do not show this banner to the same user more than: 1". I´m running four phpadsnew scripts (one for banner, one for popups, one for skyscraper, one for layer) on one server and the databases of these scripts onto another server. If I use the deliveryoption "1 ad per user" too much oder if there are too much campaigns with this option running, this feature doesn´t work anymore and there is shown an ad on every site. (which isn´t so funny for the users to see on every page a layer-ad and/or a popup) The load of both servers is still ok. Is there any way to solve this problem, without changing some of the databases or scripts onto a third server? It´s runs without any problem, if there is not much traffic on my site or if i deactive some of these campaign where the mentioned delivery option is active.

Thank you all for any kind of help!
Craig

[y2ksrs]

Hi all,

We are running phpAdsNew 2.0 to serve about 1 million to 2 million adviews a day. The hardware configuration of the system on which we have hosted phpAdsNew 2.0 is as follows

CPU: 2x Intel Xeon 2.67 Ghz
RAM: 1x 1024 MB RAM
Storage: 3x 18 GB SCSI
OS: RedHat Enterprise Linux

The problem that we face is that the used RAM goes more than 950 MB when heavy adserving takes place (somewhere around 1000 views per minute during the peak time). The used RAM grows gradually and once the free RAM goes less than 25 MB, phpAdsNew seems to stop the serving of ads. This seems to be happening as a phenomenon every time there is heavy serving. We had a doubt on Apache, so every time this happens, we had to stop and start Apache. It will work fine for some time, but again the problem will start to resurface. Slowly the used RAM grows and once the free RAM goes below 25-27 MB, ads will stop appearing.

Is this normal to phpAdsNew. Can I do any tweaking to phpAdsNew to stop this from happening or should I resort to any upgrade of the hardware. I have been going through all the posts in this thread, and time and again, I have found many people suggesting the use of PHPAccelerator. We are running PHP 4.3.7 on Apache 2.0. Will the use of PHPAccelerator show any substantial improvement in the performance of phpAdsNew. Another suggestion that I found was the use of thttpd instead of Apache, will it show any substantial improvement in performance.

Or is the problem related to MySQL. We run MySQL 4.0.20. Our phpAdsNew database is in the InnoDB format. We have the verbose mode enabled since we need to generate extensive reports based on the adserver's data.

[kenmcd2003]

Review your MySQL settings for max_connections, interactive_timeout, and connect_timeout variables.

You may have them set too high.
The high initial number of connections causes too many to open rapidly.
The connections do not expire fast enough so the number of connections just keeps climbing.
This causes MySQL to keep opening connections (and server threads) until Linux runs out of memory.
Apache dies and the ads stop serving until you reboot.
Try max_connections=250.
Make sure "persistent connections" is off in phpAdsNew settings.

Search this forum for "max_connections" to see more discussions.

MySQL has a nice free tool which allows you to see these settings in action (live graphs) and adjust them in real time.
Download the MySQL Administrator here:
http://www.mysql.com/products/administrator/

[weinstock]

I need some help. I've compiled and installed thttpd. I have a separate hostname/IP
that I can use for static content. But I don't know where to go from here to configure
things. In particular could you explain how:

i let apache serve all my dynamic pages and everything that is static (images, css) i run through thttpd.

and also

use apache mod_rewirte to direct all of the image requests over to a second server (i have 2 ips on the same machine and just gave them different names) and it works like a champ!

Can someone please give me a step-by-step on this?

Thanks,

Chuck

[bsandersonwjs]

I am seeing around 7million+ ads hits a day with my phpadsnew install.

I have 4 fronted web servers each split between two load balancers for failover.

They all are running off the same backend db server. I hope to build some kind of fail over for my db at some point in the future.

Web and DB - All servers are dual Xenon cpu with 1 gig memory.

I have not tuned anything Redhat ES 3.0 and stock phpadsnew and at peak times I see the front end web server stay around 45% ideal. The database server is a little over kill.


LoadBalancer1 LoadBalancer2
/ \ / \
Web1A Web1B Web2A Web2B
\ \ / /

DB Server


If anyone has a good fail over solution for the db part let me know.
thanks
bill s.

[4tari]

LoadBalancer1 LoadBalancer2
/ \ / \
Web1A Web1B Web2A Web2B
\ \ / /

DB Server

I guess webA & webB serve different sites?

If not, wouldn't it be more ideal to use ALL of those servers without failover?... if a server or two goes down you just replace it/them.

ie...

Loadblancer1
\ \ \ \
W1 W2 W3 W4
\ / / /
DATABASE SERVER

[jasonboowa]

Hi

I have PAN on a server with
Dual AMD Opteron 244 Processors1 Gig RAM.
We are delivering about 2 million - 2.5 million adviews a day. Most of them GoogleAdsense and other thrid party that require just a redirect (no image delivered by the server).
The DB is on another server and connects through PrivateNet.
We have file delivery cache turned on (and working)

Here is a top of the server at fairly heavy time (not peak, but not far off)

CODE

load average: 3.61, 4.42, 4.56
103 processes: 101 sleeping, 2 running, 0 zombie, 0 stopped
CPU states:  cpu    user    nice  system    irq  softirq  iowait    idle
          total   56.9%    0.0%    6.8%   0.6%     1.8%    0.0%   33.5%
          cpu00   58.4%    0.0%    6.1%   0.3%     1.1%    0.0%   33.7%
          cpu01   55.4%    0.0%    7.5%   0.9%     2.5%    0.0%   33.3%
Mem:  1009512k av,  971596k used,   37916k free,       0k shrd,   74428k buff
                   269824k actv,  478008k in_d,   20792k in_c
Swap: 1052216k av,       0k used, 1052216k free                  704304k cached

 PID USER     PRI  NI  SIZE  RSS SHARE STAT %CPU %MEM   TIME CPU COMMAND
18601 apache    15   0 13352  13M  8228 S     2.1  1.3   0:08   0 httpd
18686 apache    15   0 13320  13M  8224 S     2.1  1.3   0:01   0 httpd
18656 apache    15   0 13348  13M  8224 S     2.0  1.3   0:03   0 httpd
18672 apache    16   0 13312  13M  8224 S     1.9  1.3   0:02   1 httpd

Is there something I should be lookign at to improve performance ?
Suggestions ?

Or is this config too small ? If so, which swould help more :
More RAM ?
Faster CPUs ?

Thnaks

Jason

[Ineluki]

Hello,

We are testing phpAdsNew 2.0.8 and we have some questions about what's the prefect hardware configuration to get the best performance.

We'll serv about 20Mio per day (1.5Mio hour during peak time), we use allways external benners served via Netcaches.

The current configuration we are considering is the following:

Webhead (only delivering PAN content):
CPU: Xeon - 3.06
RAM: 2GB
Storage: SCSI
Apache or Thttpd (dunno yet)

Database only for PAN:
CPU: Xeon - 3.06
RAM: 2GB
Storage: SCSI
Mysql 5.0

Checking the forum we are considering that the planned configuration
won't support 20Mio adviews per day.

So, we would like some advice about what would be the most
suitable configuration for our needs.

Thanks,

Albert

[jasonboowa]

Hi

We are delivering about 2 million a day. The ad serving server (as it were) is and doesn't seem to flinch with this load. Whether it would go up to 20 million or not is another matter.
Processor: Dual AMD Opteron Dual Core 270 2.0 GHz
RAM : 1 Gig
What I have found out (through trial and error) is that :
CPU is more important than RAM. RAm is hardly used atall as long as the CPU is powerful enough. We have a Gig of RAM, but it never uses more than 200 Mb.
So, I guess what I am saying is : for the ad serving server, get the fastest CPU combi you can - if you are hitting your RAM hard, then your server is just not fast enough.

As for the database, I have found that with query cache turned on, the DB load of PAN is pretty small too. Last year, upgrading MySQL and using query caching took us from a serious overload problem to having some space to grow...

Anyway
Hope this helps

Jason

[Anthony Ettinger]

Are there any quick-n-dirty optimizations i can do for my tables? I do not have root and am on a shared server, so my options are probably limited.

[till]

Just wondering what PHP modules/extensions are really needed to run phpAdsNew 2. We already dedicated a server to phpAdsNew 2 and are looking to make PHP's footprint a bit lighter. Since this is a the "performance tuning" thread I thought it's appropriate to ask.

We roughly serve 120,000 banner per day. Probably more.

[scott_switzer]

One way to find out is to remove all PHP extras, then see how many failures you get in the test suite. Add them back one by one until you get all green.

Note that the test suite is not complete - so after doing this exercise, a smoke test would be required as well.

Scott

[till]

One way to find out is to remove all PHP extras, then see how many failures you get in the test suite. Add them back one by one until you get all green.

Note that the test suite is not complete - so after doing this exercise, a smoke test would be required as well.

Scott

You seriously don't know yourself what functions were used?

[scott_switzer]

No. I do know that we do not compile in any additional PHP extensions. But your question was - what is the minimum amount needed in PHP for PAN to work.