12. Implementer
13. Unique ID
14. Title
15. Description
16. Planned Dates
17. Actual Dates
18. Current Status
20. Collaboration Type
21. Flow Type
22. Aid Type
23. Finance Type
24. Sector
25. Sub-national Location
26. Tied Aid Status
27. MoU
28. Evaluations
29. Objectives
30. Budget Docs
31. Contracts
32. Tenders
33. Overall Cost
34. Planned Expenditure
35. Actual Expenditure
36. Budget Identifier
37. Results
38. Impact Appraisals
39. Conditions
Publication Status
Not Published
Source
No data available.
Comments
This information could not be found.
Click here for indicator definition
Click here to view history
17. Actual dates
Stage
Status
Format
Source
Comments
Researcher
Not published
Not published
N/A
Planned dates are published in the project profiles in the funded projects' database. There is however no information available on actual
Expand...dates.
Donor Review
Not published
Not published
PWYF Review
Not published
Not published
Independent Reviewer
Disagree
This is one of the main bottlenecks steaming from the fact that no information is usually published once the IPA assistance/project
Expand...has been awarded/selected.
PWYF Final Assessment
Not published
Not published
This information could not be found.
Publication Status
Sometimes
Format: Website
Source
http://mapa.euinfo.rs
Comments
Based on the reviewer's feedback, PWYF conducted a review of all IPA activities in Serbia published on the mapa.euinfo.rs website. No activities were found which started during 2012 or 2013, so the database is not considered to be a comprehensive listing of all current activities. Response changed to 'sometimes published' to reflect this.
Click here for indicator definition
Click here to view history
25. Sub-national location
Stage
Status
Format
Source
Comments
Researcher
Always
Website
http://mapa.euinfo.rs/map/projectdetail/77?project_id=128
Donor Review
Always
Website
Independent Reviewer
Disagree
Both websites with information with projects/activities (http://mapa.euinfo.rs/, http://www.europa.rs/en/kakoDoFondova/dodeljeni-ugovori.html) are out of date or do not include all projects funded under IPA
Expand...2012.
PWYF Final Assessment
Sometimes
Website
http://mapa.euinfo.rs
Based on the reviewer's feedback, PWYF conducted a review of all IPA activities in Serbia published on the mapa.euinfo.rs website. No
Expand...activities were found which started during 2012 or 2013, so the database is not considered to be a comprehensive listing of all current activities. Response changed to 'sometimes published' to reflect this.
Publication Status
Not Published
Source
No data available.
Comments
This information could not be found in ELARG's IATI files in the final pull of IATI data for the Index.
Click here for indicator definition
Click here to view history
26. Tied Aid Status
Stage
Status
Format
Source
Comments
Researcher
Not published
Not published
N/A
Did not find a clear policy stated anywhere on the website.
Donor Review
Not published
Machine readable
Info in XML files
Info in XML files
PWYF Review
Not published
Not published
This indicator will be assessed automatically if found in Enlargement's IATI data files in the final pull of IATI data for
Expand...the Index, subject to the files meeting the test conditions. If not, the researcher's original response will apply.
Independent Reviewer
Disagree
PWYF Final Assessment
Not published
Not published
This information could not be found in ELARG's IATI files in the final pull of IATI data for the Index.
Publication Status
Not Published
Source
No data available.
Comments
Based on the feedback provided by the independent reviewer, the score has been changed to 'not published'. The Stabilization and Association Agreement outlines EU-wide engagement between the EU and the Republic of Serbia.The document does not specifically refer to the provision of aid flows from the European Commission to Serbia so it does not meet the criteria used to score this indicator.
Click here for indicator definition
Click here to view history
27. MoU
Stage
Status
Format
Source
Comments
Researcher
Always
Document
http://www.europa.rs/upload/documents/key_documents/2008/SAA.pdf
The EU Member States and Serbia signed the Stabilization and Association Agreement in Luxembourg on 29 April 2008.
Meanwhile, after
Expand...a two-year postponement of the ratification caused by insufficient cooperation with the Hague Tribunal, the agreement was ratified by 26 EU Member States. Spain was the first to ratify the Agreement with Serbia on 19 January 2010, and Romania was the last to do it on 21 May 2012. This suggests that the agreement is valid for the 'current' period.
Donor Review
Always
Document
PWYF Review
Always
Document
Independent Reviewer
Disagree
SAA is the overall agreement on relations between the EU and Serbia. Actually, when it comes to EC financial assistance-IPA, the
Expand...MoU is called IPA financing agreement between the EC and Republic of Serbia for a given year. I could find that the one for 2012 was signed in December 2912 (it is normal to be late), but the document itself is not publicly available (I could not find it on-line). What is available is the IPA National Programme 2012 for Serbia which includes list of projects/activities to be finance, but it might not include support such as direct budgetary support to the country. I would urge you to consider, since one of the main problems of IPA assistance is the unavailability of data on the level of MoU and once the activity/project is launched (e.g. projects reports).
PWYF Final Assessment
Not published
Document
Based on the feedback provided by the independent reviewer, the score has been changed to 'not published'. The Stabilization and Association
Expand...Agreement outlines EU-wide engagement between the EU and the Republic of Serbia.The document does not specifically refer to the provision of aid flows from the European Commission to Serbia so it does not meet the criteria used to score this indicator.
Publication Status
Always
Format: Document
Source
http://ec.europa.eu/enlargement/news_corner/key-documents/index_en.htm?key_document=08012624887bedda
Comments
The independent reviewer raises an important point about the timeliness of the release of evaluation reports. However, as per the scoring guidelines, evaluations are considered to be 'always published' if they are published within their regular cycles. If information on on-going evaluations is not published when completed, this will be reflected in future years' scores.
Click here for indicator definition
Click here to view history
28. Evaluations
Stage
Status
Format
Source
Comments
Researcher
Not published
Document
N/A
No evaluations published for financial assistance provided to Serbia. The annual progress report document does not appear to include evaluative information
Expand...on activities. See here: http://ec.europa.eu/enlargement/pdf/key_documents/2012/package/sr_rapport_2012_en.pdf
Donor Review
Sometimes
Document
http://ec.europa.eu/enlargement/news_corner/key-documents/index_en.htm?key_document=08012624887bedda
all evaluations for DG Enlargement collected on ELARG website, and they can be selected per country.
PWYF Review
Always
Document
Response changed to 'always published' since the last evaluation for Serbia was published in 2011 which we assume is within their
Expand...normal evaluation cycle given the range of evaluation documents available for other countries.
Independent Reviewer
Disagree
The strategic evaluation for Serbia was indeed published in January 2011, which means it took place in the course of 2010
Expand...and it assesses intervention logic of the assistance for period 2008-2011 and touches in assessing project/activity level for period 2007-2009, which means that the assessment is limited and not related to the given year. The EU has regular both thematic and country eveluations, but this become publicly available very late and since they are usually conducted at the level of several years or sectors, the evaluation covers only a sample of activities/project indicating situation at the sector or country level and never all projects. EUD and Government of Serbia have in 2012 within SWAP approach launched 5-year (2007-2011) evaluations per all sectors as a basis for planning use of IPA 2014-2020 funds for Serbia, but some of the evaluations are still ongoing and I believe are not intended to be made publicly available (this is from personal account as I acted as an expert for the civil society sector evaluation).
PWYF Final Assessment
Always
Document
http://ec.europa.eu/enlargement/news_corner/key-documents/index_en.htm?key_document=08012624887bedda
The independent reviewer raises an important point about the timeliness of the release of evaluation reports. However, as per the scoring
Expand...guidelines, evaluations are considered to be 'always published' if they are published within their regular cycles. If information on on-going evaluations is not published when completed, this will be reflected in future years' scores.
Publication Status
Sometimes
Format: Document
Source
http://mapa.euinfo.rs
Comments
Based on the reviewer's feedback, PWYF conducted a review of all IPA activities in Serbia published on the mapa.euinfo.rs website. No activities were found which started during 2012 or 2013, so the database is not considered to be a comprehensive listing of all current activities. Response changed to 'sometimes published' to reflect this.
Click here for indicator definition
Click here to view history
29. Objectives
Stage
Status
Format
Source
Comments
Researcher
Always
Document
http://mapa.euinfo.rs/map/projectdetail/61?project_id=135
Donor Review
Always
Document
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm
info is present on individual project fiches published on Enlargement website.
PWYF Review
Always
Document
Independent Reviewer
Disagree
Again, at the level of projects/activities this is always published, but since not all projects are published not all objectives of
Expand...assistance at the project level are available (see Map of projects and contract database mentioned before).
PWYF Final Assessment
Sometimes
Document
http://mapa.euinfo.rs
Based on the reviewer's feedback, PWYF conducted a review of all IPA activities in Serbia published on the mapa.euinfo.rs website. No
Expand...activities were found which started during 2012 or 2013, so the database is not considered to be a comprehensive listing of all current activities. Response changed to 'sometimes published' to reflect this.
Publication Status
Sometimes
Format: Document
Source
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm; e.g. http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_6_social_development.pdf
Comments
For this indicator, indicative or planned budget documents can be accepted as long as the information provided is broken down by different spending lines.
In line with comments on the comprehensiveness of activity level information for other indicators, the response has been changed to 'sometimes published.'
Click here for indicator definition
Click here to view history
30. Budget Docs
Stage
Status
Format
Source
Comments
Researcher
Not published
Document
N/A
Overall cost of activities published but no budget documents appear to be available.
Donor Review
Always
Document
.http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm; e.g. http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_6_social_development.pdf
Expand...info is present on individual project fiches published on Enlargement website,
PWYF Review
Always
Document
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm; e.g. http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_6_social_development.pdf
Expand...Response changed to 'always published' based on evidence provided by the donor.
Independent Reviewer
Disagree
It is correct that budget information are available for all countries covered by IPA in country fishes, but bear in mind
Expand...that they are presented at the level of tender or call for proposals which ultimately result in projects/activities. Detailed project budgets (except for overall cost and EC-contribution) are not publicly available.
PWYF Final Assessment
Sometimes
Document
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm; e.g. http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_6_social_development.pdf
Expand...For this indicator, indicative or planned budget documents can be accepted as long as the information provided is broken down by
Expand...different spending lines.
In line with comments on the comprehensiveness of activity level information for other indicators, the response has been changed to 'sometimes published.'
Publication Status
Always
Format: Document
Source
http://ec.europa.eu/budget/fts
Comments
New evidence found in the final review stage on the FTS website of the EC.
Click here for indicator definition
Click here to view history
31. Contracts
Stage
Status
Format
Source
Comments
Researcher
Sometimes
Document
http://ec.europa.eu/enlargement/pdf/how_does_it_work/grants_tenders/list_of_contractors/20120410_anual_list_of_contractors.pdf
Publishes an annual list of contractors, but this list is not currently available for 2012.
Donor Review
Sometimes
Document
http://ec.europa.eu/europeaid/work/funding/beneficiaries/index.cfm?lang=en
info on contracts published on DG DEVCO website up to year 2011
PWYF Review
Sometimes
Document
Independent Reviewer
Disagree
Additional to annual list of contracts (grants, services etc.), usually the EU Delegation in country (Serbia) publishes a list of
Expand...contracts awarded. The EUD Serbia has such list published, but again only up until 1st August, 2011: http://www.europa.rs/en/kakoDoFondova/dodeljeni-ugovori.html. Do note that contracts as such are not published, just basic data about the activity (project). At the level of IPA civil society support, where we do ongoing monitoring, we have encountered problems by some EUDs (not Serbia though, but Bosnia and Herzegovina especially), where the award notices have in some cases never been made public!
PWYF Final Assessment
Always
Document
http://ec.europa.eu/budget/fts
New evidence found in the final review stage on the FTS website of the EC.
Publication Status
Always
Format: Document
Source
http://ted.europa.eu/TED/main/HomePage.do and https://webgate.ec.europa.eu/europeaid/online-services/index.cfm?ADSSChck=1284977262222&do=publi.welcome&userlanguage=en
Comments
Published on the Europa and DEVCO websites.
Click here for indicator definition
Click here to view history
32. Tenders
Stage
Status
Format
Source
Comments
Researcher
Sometimes
Document
http://ec.europa.eu/enlargement/tenders/tenders/index_en.htm
The Enlargement website has a section on tenders. There are no current open calls for tenders available. Clicking on previous calls
Expand...for tenders shows details for only one tender. Need clarification whether tenders are always published and if so how they can be accessed.
Donor Review
Always
Document
http://ted.europa.eu/TED/main/HomePage.do and https://webgate.ec.europa.eu/europeaid/online-services/index.cfm?ADSSChck=1284977262222&do=publi.welcome&userlanguage=en
Expand...info on current and forthcoming tenders on Europa and DEVCO websites
PWYF Review
Always
Document
http://ted.europa.eu/TED/main/HomePage.do and https://webgate.ec.europa.eu/europeaid/online-services/index.cfm?ADSSChck=1284977262222&do=publi.welcome&userlanguage=en
Expand...Response changed to 'always published' based on evidence provided by the donor.
Independent Reviewer
Disagree
Note that the same website as per DG DEVCO publishes all tenders centrally: https://webgate.ec.europa.eu/europeaid/online-services/index.cfm?ADSSChck=1284977262222&do=publi.welcome&userlanguage=en
Expand...
PWYF Final Assessment
Always
Document
http://ted.europa.eu/TED/main/HomePage.do and https://webgate.ec.europa.eu/europeaid/online-services/index.cfm?ADSSChck=1284977262222&do=publi.welcome&userlanguage=en
Expand...Published on the Europa and DEVCO websites.
Publication Status
Sometimes
Format: Website
Source
http://mapa.euinfo.rs/
Comments
Based on the reviewer's feedback, PWYF conducted a review of all IPA activities in Serbia published on the mapa.euinfo.rs website. No activities were found which started during 2012 or 2013, so the database is not considered to be a comprehensive listing of all current activities. Response changed to 'sometimes published' to reflect this.
Click here for indicator definition
Click here to view history
33. Overall cost
Stage
Status
Format
Source
Comments
Researcher
Always
Website
http://mapa.euinfo.rs/map/projectdetail/77?project_id=128
Donor Review
Always
Machine readable
Info in XML files
Info in XML files: overall cost of the activity is the total commitment for each activity.
PWYF Review
Always
Website
This indicator will be assessed automatically if found in Enlargement's IATI data files in the final pull of IATI data for
Expand...the Index, subject to the files meeting the test conditions. If not, the researcher's original response will apply.
Independent Reviewer
Disagree
Both websites with information with projects/activities (http://mapa.euinfo.rs/, http://www.europa.rs/en/kakoDoFondova/dodeljeni-ugovori.html) are out of date-information on projects or do not include all projects funded
Expand...under IPA Serbia 2012. The issue is that overall costs are usually available, but since not all projects are updated, this is not available for all IPA support (projects) in Serbia for 2012. I can confirm this for certain for civil society support as we developed a list of all awarded projects for all countries including Serbia (http://www.balkancsd.net/images/77-1_IPA_CSF_2007-2011_grant_list_FINAL.pdf). It might be also that the donor is referring to IPA 2012 for the year the assistance was programmed and not when the award was made/contract signed.
PWYF Final Assessment
Sometimes
Website
http://mapa.euinfo.rs/
Based on the reviewer's feedback, PWYF conducted a review of all IPA activities in Serbia published on the mapa.euinfo.rs website. No
Expand...activities were found which started during 2012 or 2013, so the database is not considered to be a comprehensive listing of all current activities. Response changed to 'sometimes published' to reflect this.
Publication Status
Not Published
Source
No data available.
Comments
This information could not be found.
Click here for indicator definition
Click here to view history
36. Budget Identifier
Stage
Status
Format
Source
Comments
Researcher
Not published
Not published
N/A
This information does not appear to be published
Donor Review
Not published
Not published
PWYF Review
Not published
Not published
Independent Reviewer
Disagree
PWYF Final Assessment
Not published
Not published
This information could not be found.
Publication Status
Sometimes
Format: Pdf
Source
http://ec.europa.eu/enlargement/news_corner/key-documents/index_en.htm
Comments
The CSO reviewer highlights problems with accessing detailed results information. However, as some examples of results information were found the score for this indicator will remain as 'sometimes published' although the issues are noted. This information is not consistently published hence it cannot be scored as 'always published'.
Click here for indicator definition
Click here to view history
37. Results
Stage
Status
Format
Source
Comments
Researcher
Not published
Not published
N/A
Expected results are published in the project files but no actual results for completed projects. See here: http://mapa.euinfo.rs/map/projectdetail/70
Expand...
Donor Review
Sometimes
Pdf
http://ec.europa.eu/enlargement/news_corner/key-documents/index_en.htm
Collection of results/evaluation reports for DG Enlargement on website. Documents can be searched per country. Expected results always published in project
Expand...fiches on the website.
PWYF Review
Sometimes
Pdf
Changed to 'sometimes published' based on evidence provided by the donor.
Independent Reviewer
Disagree
I would not take evaluation as a real evidence of publishing results. Sometimes EC/EUD publishes a fact sheet or a booklet
Expand...of project results, but this is for visibility/demonstration processes (e.g. http://www.civilnodrustvo.rs/ with results and activities information per projects funded under the Support to Civil Society call for proposals). Evaluations are usually a technical exercise (I have acted as evaluator for EUD Serbia so this is a first hand account) and look at projects from a multi-year or sector perspective. Publishing project/activity results is a real bottleneck for the EU/EC as it is the ultimate link providing for reflection on achieving policy objectives set in Enlargement policy driving IPA funding and strategic and effective use of IPA funding. The project fiches mentioned by the donor do include expected results, but it is a planning document, thus expressing what the donor wants to achieve and not evaluation/report showing what has actually been achieved.
PWYF Final Assessment
Sometimes
Pdf
http://ec.europa.eu/enlargement/news_corner/key-documents/index_en.htm
The CSO reviewer highlights problems with accessing detailed results information. However, as some examples of results information were found the score
Expand...for this indicator will remain as 'sometimes published' although the issues are noted. This information is not consistently published hence it cannot be scored as 'always published'.
Publication Status
Sometimes
Format: Document
Source
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm , e.g. http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_9_energy_efficiency.pdf
Comments
It is not possible to use ‘project’ fiches to score this indicator as ‘always published’ as these documents do not contain the necessary information for each individual activity within a sector of operation or programme component. This is consistent with the scoring approach which has been applied to all other EC departments.
Click here for indicator definition
Click here to view history
38. Impact Appraisals
Stage
Status
Format
Source
Comments
Researcher
Not published
Document
N/A
No impact appraisals found.
Donor Review
Always
Document
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm , e.g. http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_9_energy_efficiency.pdf
Expand...Relevant information is included into project fiches
PWYF Review
Always
Document
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm , e.g. http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_9_energy_efficiency.pdf
Expand...Response changed to 'always published' based on evidence provided by the donor.
Independent Reviewer
Disagree
At the level of activity/project, impact appraisal (assessment) is part of project proposal and this as part of the contract signed
Expand...with the EC, but the problem is that this documents are never publicly available. What the donor and PWFY assessment is reporting is an impact appraisal available at the level of project fiche, which is at the level of planning and not the lowest level at which the activity/support is actually being implemented.
PWYF Final Assessment
Sometimes
Document
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm , e.g. http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_9_energy_efficiency.pdf
Expand...It is not possible to use ‘project’ fiches to score this indicator as ‘always published’ as these documents do not contain
Expand...the necessary information for each individual activity within a sector of operation or programme component. This is consistent with the scoring approach which has been applied to all other EC departments.
Publication Status
Not Published
Source
No data available.
Comments
Based on PWYF original findings and as a result of the reasons outlined by the reviewer, the response has been changed to 'not published'. In order to score on this indicator conditions need to be explicitly stated per activity or made clear that they cover all activities and no additional conditions apply to specific activities.
Click here for indicator definition
Click here to view history
39. Conditions
Stage
Status
Format
Source
Comments
Researcher
Not published
Document
N/A
Conditions not specified for each activity or project.
Donor Review
Always
Document
general webpage for project fiches http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm;
example: http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_6_social_development.pdf
Expand...Information included in Project fiches published on DG Enlargement website, country pages
PWYF Review
Always
Document
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm; example: http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_6_social_development.pdf
Expand...Response changed to 'always published' based on evidence provided by the donor.
Independent Reviewer
Disagree
On project level this is stipulated at the level of contract (service, grant etc.), which is based on standard EC documents
Expand...for external support. So templates of contracts, including conditions are available (http://ec.europa.eu/europeaid/prag/document.do;jsessionid=1yGDR4QM2fTnwDhBvdxXzrGM0tMp1T58Sgn8QGYykQ2FyhtHh9gk!-963858406). The issue is that contracts as such are not publicly available at the level of activity, while they are at the level of organization.
PWYF Final Assessment
Not published
Document
Based on PWYF original findings and as a result of the reasons outlined by the reviewer, the response has been changed
Expand...to 'not published'. In order to score on this indicator conditions need to be explicitly stated per activity or made clear that they cover all activities and no additional conditions apply to specific activities.